About

jwals
Jason Walsh
Rank:
Community Participant
Title:
Joined:
Apr 24, 2023 11:01:38 AM
Posts:
24
Solutions:
2
Likes Received:
17
Bio:
An amazing Instructure Community member

Most Liked Posts

Hi @canninga, yes unfortunately the examples that Instructure provides are non-working code. Python's asyncio library requires that things look like my code below. However, you can also use th...
Likes: 3
We use the DAP Python library within an AWS solution. On October 19, we had 78 tables fail with the "Middleware error" and 12 succeed in syncing. October 20 we had 65 tables sync successfully ...
Likes: 3
Hi Jeff, If your goal is to get the Parquet (or other format) files into S3, this is fairly straightforward by using the DAP API endpoints. We do this with the web_logs files and simply store them in ...
Likes: 2
Hi @BobODell , We have a daily job that refreshes the 90 tables in the canvas namespace, stored in a PostgreSQL database. This job typically takes under ten minutes. We also have a weekly job that...
Likes: 2
We had 66 out of 90 tables fail this morning. We have implemented an AWS-based solution that kicks off a Lambda process for each table. We have the processes configured to time out after five minutes,...
Likes: 2

Most Recent Posts

We had not been bothering with meta.action for web_logs on the assumption that the number of deletes should be statistically insignificant for looking at broad usage patterns and aggregates, which is ...
Aug 19, 2024 11:06:18 AM
Hi Jeff, If your goal is to get the Parquet (or other format) files into S3, this is fairly straightforward by using the DAP API endpoints. We do this with the web_logs files and simply store them in ...
Aug 16, 2024 7:11:00 AM
Hi @StevenWalls, yes for better or worse this is par for the course. Skimming through our log history (not guaranteed to be exhaustive), we had some number of tables -- anywhere between 1 and 26 -...
May 14, 2024 7:09:20 AM
A screenshot of our web_logs state machine is above in this thread; it's really pretty simple, and the underlying Python code isn't much more complicated. I'm happy to share that privately...
Apr 8, 2024 10:46:02 AM
Thanks very much for flagging that, @LeventeHunyadi. Is there a changelog or something where that was communicated? I appreciate your heroic attention to the forum but I'm also slightly concer...
Mar 15, 2024 7:50:32 AM

Latest Badges

Instructure Community: 1 Year

Instructure Community: 1 Year

1 Year with Instructure Community

Earned: 2024-05-14

50 Logins Completed

50 Logins Completed

Earned: 2024-03-08

25 Logins Completed

25 Logins Completed

Earned: 2024-01-25

15 Logins Completed

15 Logins Completed

Earned: 2024-01-25