This would make it easier to iterate over the prep and fitting separately. It will also allow intervention between the prep and fitting.
I suggest the prep stage be more closely aligned with the current ingest stage. It is responsible for gathering data, so; mist lookup, ephemeris lookup, refine ephemeris, pre-process LCs (detrend/flatten) arrange LCs, EBOP MAVEN preds, generate LD params. It would write out fitting input params and LC dat files?
The output from the prep stage would be everything needed to fit the LCs with JKTEBOP. The fit stage would be; fitting (task 3 or task 8) incl retries/timeouts etc, aggregetion of results, write out fitted params.
This would make it easier to iterate over the prep and fitting separately. It will also allow intervention between the prep and fitting.
I suggest the prep stage be more closely aligned with the current ingest stage. It is responsible for gathering data, so; mist lookup, ephemeris lookup, refine ephemeris, pre-process LCs (detrend/flatten) arrange LCs, EBOP MAVEN preds, generate LD params. It would write out fitting input params and LC dat files?
The output from the prep stage would be everything needed to fit the LCs with JKTEBOP. The fit stage would be; fitting (task 3 or task 8) incl retries/timeouts etc, aggregetion of results, write out fitted params.