Migrating to Canvas Data 2 - Rework old code or use a new approach

ChrisWolf93
Community Member

Hello everyone,

We are working to update to Canvas Data 2, but our current method of using canvas-data-sdk is no longer compatible following the canvas data 2 changes.

Our current method does the following with 3 commands total using canvas-data-sdk on canvas data 1:

  1. Gets the schema for ALL tables
  2. Generates a Postgres or Amazon Redshift compatible DDL script based on the JSON-formatted schema above.
  3. Fetches all of the files for that dump, decompress them, and re-assembles them into a single file for each table

I have used the CLI and have been able to successfully get snapshots of data from a singular table, query a table, and so on. With that said, I am not sure the best way to recreate what was previously done using the tool linked above. 

Is trying to recreate the approach listed above with the CLI a good route to take? Or would it be best to rewrite the workflow in a different way, possibly just interacting with specific tables instead of all of the data?

Thanks!

0 Likes