I am new tidal. I have a scenario.
I need to loop through 10 databases for given set of tables ..say 1.
I have created table A which has entry for each of the tables and the databases , so total 10 records.
I have a ETL job for each table. I am planning to create a file trigger at the beginning of Tidal job step and then select top first record from table A run the ETL job first database.
I need tidal to keep running this job till file trigger is available. Once I am done with all 10 databases, I will delete the trigger file thus finishing the Tidal job run.
In theory, it should work. I am not sure if this will work in Tidal. If not what are my other option ?