Migrating to Canvas Data 2 - Rework old code or use a new approach
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-14-2023
09:07 AM
Hello everyone,
We are working to update to Canvas Data 2, but our current method of using canvas-data-sdk is no longer compatible following the canvas data 2 changes.
Our current method does the following with 3 commands total using canvas-data-sdk on canvas data 1:
- Gets the schema for ALL tables
- Generates a Postgres or Amazon Redshift compatible DDL script based on the JSON-formatted schema above.
- Fetches all of the files for that dump, decompress them, and re-assembles them into a single file for each table
I have used the CLI and have been able to successfully get snapshots of data from a singular table, query a table, and so on. With that said, I am not sure the best way to recreate what was previously done using the tool linked above.
Is trying to recreate the approach listed above with the CLI a good route to take? Or would it be best to rewrite the workflow in a different way, possibly just interacting with specific tables instead of all of the data?
Thanks!