CD2 Download Issues today, anyone else?

[audra_agnelly]

We're running into issues downloading our files today, is anyone else experiencing issues? We're not getting error messages, but nothing is downloading. We've tried to manually download one table, grading_periods, which should take a few seconds and we just get query job still in status: running

[stimme]

@audra_agnelly Yes, our scheduled CD2 downloads failed this morning.

I tried to get an incremental csv file for the accounts table a minute ago, and the response was: 

2023-11-27 10:48:21,696 - ERROR - An exception occurred while executing the command: DAP Querying service is overloaded or under maintenance. (fba240d3-c115-4ff2-9b8d-9a2d258804e9)

[stimme]

We also have not received new CD1 snapshots for five days.

[mclark19]

We have also not received CD1 snapshots in about five days. CD2 has been relatively stable, but web_logs failed today.

[DanielMoore]

We have also not received CD1 snapshots in five days. We are working on our CD2 migration, but it is not complete yet.

[sor1]

My CD1 snapshot worked today (2023-11-30)

[J-J-Jason]

I haven't been able to download anything today. 🤷‍♂️

[marco_divittori]

I'm also running into issues yet Canvas Data 2 status currently listed as "Operational" on status page.

https://status.instructure.com/

[AlexShin]

I wouldn't bother using the CD2 status as a metric of anything until Instructure re-thinks how they're treating the "Operational" flag. They indicated that they won't change the status unless the entire CD2 API is down for all users. Most other cases they claim it is just "degraded service" and leave it as operational. There were multiple weeks of web_logs being down for the entire US-East-1 AWS region and the status was green. We've had multiple days of hitting repeated "service overloaded or under maintenance" errors when trying to refresh our tables and no indication of trouble according to their status indicator. 

[blenihan]

We are getting timeouts for CD2. I thought something was wrong with our scripts, but we cannot download any of our tables.  The table list query seems to be working fine. 

We keep having issues with CD 2 and have not successfully transitioned. Over the weekend we got an e-mail that Instructure is planning on turning off our CD 1 on the 1st of December. They did have a mechanism to ask for an extension, which I guess we will do. 

[Jomark_SD]

We are also having intermittent issues during extraction via the CD2 APIs. We are in a Production environment pulling deltas on 92 tables daily, having completed all snapshots, but cannot seem to have a clean series of incremental runs without having any connection/timeout-like issues, considering incrementals are short extracts.

[jsimon3]

`request. ---> System.Net.WebException: The remote name could not be resolved: 'data-access-platform-output-prod-iad.s3.amazonaws.com'`
-- I feel sad again
-- I thought most of the issues were settled but I found a new error, not related to the hour timeout on token....