SIENTIAPDE-1214: Enhance MLFlow and tests with datetime index handling and logging improvements - Added a new method in MLFlow to detect and parse datetime indices in DataFrames, ensuring proper format and raising errors for invalid types. - Updated prediction workflows to utilize the new datetime index handling, improving data integrity during transformations. - Enhanced logging in model_repository to include detailed data outputs for better traceability. - Adjusted timeout settings in prediction workflows for improved execution time management. - Updated tests.ipynb to include additional checks for index types and outputs for better validation of functionality.
10 KiB
10 KiB
| 1 | 303-WIT-230_median | 303-WIT-230_std | 303-WIT-230_min | 303-WIT-230_max | 305-WIT-135_median | 305-WIT-135_std | 305-WIT-135_min | 305-WIT-135_max | 305-WIT-160_median | 305-WIT-160_std | 305-WIT-160_min | 305-WIT-160_max | 305-PIT-170_median | 305-PIT-170_std | 305-PIT-170_min | 305-PIT-170_max | 305-PIT-175_median | 305-PIT-175_std | 305-PIT-175_min | 305-PIT-175_max | 305-FIT-002_median | 305-FIT-002_std | 305-FIT-002_min | 305-FIT-002_max | 305-FIT-013_median | 305-FIT-013_std | 305-FIT-013_min | 305-FIT-013_max | 306-PIT-101_median | 306-PIT-101_std | 306-PIT-101_min | 306-PIT-101_max | 306-FIT-051_median | 306-FIT-051_std | 306-FIT-051_min | 306-FIT-051_max | 306-DIT-001_median | 306-DIT-001_std | 306-DIT-001_min | 306-DIT-001_max | 306-PIT-105_median | 306-PIT-105_std | 306-PIT-105_min | 306-PIT-105_max | 306-FIT-052_median | 306-FIT-052_std | 306-FIT-052_min | 306-FIT-052_max | 306-DIT-002_median | 306-DIT-002_std | 306-DIT-002_min | 306-DIT-002_max | 306-PIT-115_median | 306-PIT-115_std | 306-PIT-115_min | 306-PIT-115_max | 306-FIT-004_median | 306-FIT-004_std | 306-FIT-004_min | 306-FIT-004_max | 306-PIT-110_median | 306-PIT-110_std | 306-PIT-110_min | 306-PIT-110_max | 306-FIT-003_median | 306-FIT-003_std | 306-FIT-003_min | 306-FIT-003_max | 306-PIT-125_median | 306-PIT-125_std | 306-PIT-125_min | 306-PIT-125_max | 306-FIT-005_median | 306-FIT-005_std | 306-FIT-005_min | 306-FIT-005_max | 306-PIT-130_median | 306-PIT-130_std | 306-PIT-130_min | 306-PIT-130_max | 306-FIT-006_median | 306-FIT-006_std | 306-FIT-006_min | 306-FIT-006_max | 307-FIT-005_median | 307-FIT-005_std | 307-FIT-005_min | 307-FIT-005_max | 307-FIT-003_median | 307-FIT-003_std | 307-FIT-003_min | 307-FIT-003_max | 307-FIC-022_median | 307-FIC-022_std | 307-FIC-022_min | 307-FIC-022_max | 310-FIT-005_median | 310-FIT-005_std | 310-FIT-005_min | 310-FIT-005_max | 307-FIT-008_median | 307-FIT-008_std | 307-FIT-008_min | 307-FIT-008_max | 307-FIT-009_median | 307-FIT-009_std | 307-FIT-009_min | 307-FIT-009_max | 309-PIT-101_median | 309-PIT-101_std | 309-PIT-101_min | 309-PIT-101_max | 309-PIT-105_median | 309-PIT-105_std | 309-PIT-105_min | 309-PIT-105_max | 309-PIT-110_median | 309-PIT-110_std | 309-PIT-110_min | 309-PIT-110_max | 309-PIT-185_median | 309-PIT-185_std | 309-PIT-185_min | 309-PIT-185_max | 309-PIT-190_median | 309-PIT-190_std | 309-PIT-190_min | 309-PIT-190_max | 309-PIT-195_median | 309-PIT-195_std | 309-PIT-195_min | 309-PIT-195_max | 309-FIT-051_median | 309-FIT-051_std | 309-FIT-051_min | 309-FIT-051_max | 309-FIT-052_median | 309-FIT-052_std | 309-FIT-052_min | 309-FIT-052_max | 309-PIT-001_median | 309-PIT-001_std | 309-PIT-001_min | 309-PIT-001_max | 309-PIT-002_median | 309-PIT-002_std | 309-PIT-002_min | 309-PIT-002_max | 317AIT003.3_median | 317AIT003.3_std | 317AIT003.3_min | 317AIT003.3_max | 317AIT003.5_median | 317AIT003.5_std | 317AIT003.5_min | 317AIT003.5_max | 317AIT003.1_median | 317AIT003.1_std | 317AIT003.1_min | 317AIT003.1_max | 317AIT003.2_median | 317AIT003.2_std | 317AIT003.2_min | 317AIT003.2_max | 317AIT002.37_median | 317AIT002.37_std | 317AIT002.37_min | 317AIT002.37_max | 317AIT002.49_median | 317AIT002.49_std | 317AIT002.49_min | 317AIT002.49_max | 317AIT002.61_median | 317AIT002.61_std | 317AIT002.61_min | 317AIT002.61_max | 317AIT002.38_median | 317AIT002.38_std | 317AIT002.38_min | 317AIT002.38_max | 317AIT002.50_median | 317AIT002.50_std | 317AIT002.50_min | 317AIT002.50_max | 317AIT002.62_median | 317AIT002.62_std | 317AIT002.62_min | 317AIT002.62_max | 317AIT002.39_median | 317AIT002.39_std | 317AIT002.39_min | 317AIT002.39_max | 317AIT002.51_median | 317AIT002.51_std | 317AIT002.51_min | 317AIT002.51_max | 317AIT002.63_median | 317AIT002.63_std | 317AIT002.63_min | 317AIT002.63_max | 317AIT002.40_median | 317AIT002.40_std | 317AIT002.40_min | 317AIT002.40_max | 317AIT002.52_median | 317AIT002.52_std | 317AIT002.52_min | 317AIT002.52_max | 317AIT002.64_median | 317AIT002.64_std | 317AIT002.64_min | 317AIT002.64_max | 317AIT002.41_median | 317AIT002.41_std | 317AIT002.41_min | 317AIT002.41_max | 317AIT002.53_median | 317AIT002.53_std | 317AIT002.53_min | 317AIT002.53_max | 317AIT002.65_median | 317AIT002.65_std | 317AIT002.65_min | 317AIT002.65_max | 317AIT002.42_median | 317AIT002.42_std | 317AIT002.42_min | 317AIT002.42_max | 317AIT002.54_median | 317AIT002.54_std | 317AIT002.54_min | 317AIT002.54_max | 317AIT002.66_median | 317AIT002.66_std | 317AIT002.66_min | 317AIT002.66_max | 317AIT002.43_median | 317AIT002.43_std | 317AIT002.43_min | 317AIT002.43_max | 317AIT002.55_median | 317AIT002.55_std | 317AIT002.55_min | 317AIT002.55_max | 317AIT002.67_median | 317AIT002.67_std | 317AIT002.67_min | 317AIT002.67_max | 317AIT002.44_median | 317AIT002.44_std | 317AIT002.44_min | 317AIT002.44_max | 317AIT002.56_median | 317AIT002.56_std | 317AIT002.56_min | 317AIT002.56_max | 317AIT002.68_median | 317AIT002.68_std | 317AIT002.68_min | 317AIT002.68_max | 317AIT002.45_median | 317AIT002.45_std | 317AIT002.45_min | 317AIT002.45_max | 317AIT002.57_median | 317AIT002.57_std | 317AIT002.57_min | 317AIT002.57_max | 317AIT002.69_median | 317AIT002.69_std | 317AIT002.69_min | 317AIT002.69_max | 317AIT002.46_median | 317AIT002.46_std | 317AIT002.46_min | 317AIT002.46_max | 317AIT002.58_median | 317AIT002.58_std | 317AIT002.58_min | 317AIT002.58_max | 317AIT002.70_median | 317AIT002.70_std | 317AIT002.70_min | 317AIT002.70_max | 317AIT002.47_median | 317AIT002.47_std | 317AIT002.47_min | 317AIT002.47_max | 317AIT002.59_median | 317AIT002.59_std | 317AIT002.59_min | 317AIT002.59_max | 317AIT002.71_median | 317AIT002.71_std | 317AIT002.71_min | 317AIT002.71_max | 317AIT002.48_median | 317AIT002.48_std | 317AIT002.48_min | 317AIT002.48_max | 317AIT002.60_median | 317AIT002.60_std | 317AIT002.60_min | 317AIT002.60_max | 317AIT002.72_median | 317AIT002.72_std | 317AIT002.72_min | 317AIT002.72_max | SiO2_conc | timestamp | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 2024-12-05 04:00:00+0000 | 2344.354736328125 | 347.11413476082527 | 2063.14990234375 | 3052.78662109375 | 1323.8238525390625 | 199.25517177489738 | 801.2099609375 | 1477.9354248046875 | 1239.42919921875 | 188.20232896348458 | 1067.496337890625 | 1611.220947265625 | 12.741495132446287 | 0.2925100433215222 | 12.14862060546875 | 13.035848617553713 | 13.396173477172852 | 0.2659367570480025 | 12.94904613494873 | 13.875475883483888 | 3156.99365234375 | 17.90496592640638 | 3128.458251953125 | 3188.196533203125 | 3328.472412109375 | 18.341293358560456 | 3293.60546875 | 3352.32080078125 | 34.44520568847656 | 0.10727337707066699 | 34.300880432128906 | 34.595943450927734 | 2251.281005859375 | 6.914512409267933 | 2241.09228515625 | 2259.91357421875 | 1.3857378959655762 | 0.001162128441763176 | 1.3840404748916626 | 1.3874353170394895 | 33.95878982543945 | 0.06905080560339776 | 33.905391693115234 | 34.107933044433594 | 2275.4189453125 | 8.067717393234235 | 2263.143798828125 | 2288.202880859375 | 1.397327542304993 | 0.0025866991350633178 | 1.3935494422912598 | 1.4011056423187256 | 31.01426696777344 | 2.797667558372099 | 24.58193588256836 | 34.75410461425781 | 2157.358642578125 | 30.47011040139319 | 2091.429931640625 | 2189.05615234375 | 32.01703643798828 | 0.027139770722953593 | 31.97739601135254 | 32.05667495727539 | 2059.924560546875 | 88.54574101606774 | 1862.8626708984373 | 2170.908447265625 | 43.65913391113281 | 0.09432217658823967 | 43.593544006347656 | 43.89741134643555 | 1866.9232177734373 | 0.05200646609213417 | 1866.84716796875 | 1866.9991455078125 | 44.08242416381836 | 0.04344513322059127 | 44.02417755126953 | 44.14066696166992 | 1714.9619140625 | 0.1883131118977155 | 1714.6802978515625 | 1715.2435302734375 | 27.0 | 0.0 | 27.0 | 27.0 | 0.7632204294204712 | 0.28421935480519783 | 0.6459924578666687 | 1.425487995147705 | 649.1517333984375 | 2.0424248177883793 | 647.1126708984375 | 653.2977294921875 | 700.892822265625 | 0.07040149596071192 | 700.7899780273438 | 700.9956665039062 | 1194.4361572265625 | 0.29912346849236254 | 1193.999267578125 | 1194.873046875 | 997.7520751953124 | 0.26607758363281586 | 997.3634643554688 | 998.1407470703124 | 23.87283706665039 | 0.040718881893752515 | 23.81103706359864 | 23.925472259521484 | 26.559722900390625 | 0.2379241176870002 | 26.20622062683105 | 26.91034507751465 | 26.35142517089844 | 0.203982336891631 | 26.06732177734375 | 26.710390090942383 | 23.415620803833008 | 0.11592992262134358 | 23.256576538085938 | 23.56723022460937 | 27.697071075439453 | 0.15510993222349723 | 27.35708808898925 | 27.844594955444336 | 27.72958755493164 | 0.19091973703305398 | 27.292091369628903 | 27.89141845703125 | 1748.264892578125 | 7.86294792652368 | 1742.1806640625 | 1768.509765625 | 1821.6829833984373 | 15.953009331205266 | 1809.867919921875 | 1854.5777587890625 | 0.1001370549201965 | 0.00019079441009214591 | 0.0998583808541297 | 0.1004157289862632 | 4.8986358642578125 | 0.0015045608215440351 | 4.8964385986328125 | 4.900833606719971 | 6.507819890975952 | 0.12657004614335984 | 6.405970096588135 | 6.699999809265137 | 86.30000305175781 | 0.3732080423947149 | 85.80000305175781 | 86.5999984741211 | 8.5 | 1.6421334224036257 | 7.89943265914917 | 12.899999618530272 | 5.400000095367432 | 1.0432607765452175 | 3.299999952316284 | 5.800000190734863 | 1.2756186723709106 | 0.0 | 1.2756186723709106 | 1.2756186723709106 | 0.7121588587760925 | 0.0 | 0.7121588587760925 | 0.7121588587760925 | 0.4104396104812622 | 0.0 | 0.4104396104812622 | 0.4104396104812622 | 0.2267737984657287 | 0.0 | 0.2267737984657287 | 0.2267737984657287 | 1.4764769077301023 | 0.0 | 1.4764769077301023 | 1.4764769077301023 | 0.6497865319252014 | 0.0 | 0.6497865319252014 | 0.6497865319252014 | 0.4203702211380005 | 0.0 | 0.4203702211380005 | 0.4203702211380005 | 1.526507019996643 | 0.0 | 1.526507019996643 | 1.526507019996643 | 0.6540470123291016 | 0.0 | 0.6540470123291016 | 0.6540470123291016 | 1.7459523677825928 | 0.002774316303229609 | 1.7381054162979126 | 1.7459523677825928 | 0.4817045927047729 | 0.0002177622295436636 | 0.4817045927047729 | 0.4823205173015594 | 0.3364990949630737 | 0.00012384851434926538 | 0.3361487984657287 | 0.3364990949630737 | 1.1931402683258057 | 0.033290363097006954 | 1.1206940412521362 | 1.1931402683258057 | 0.7161301374435425 | 0.025235254887373854 | 0.7161301374435425 | 0.7710468769073486 | 0.4127309918403625 | 0.007279004051801342 | 0.4127309918403625 | 0.428571492433548 | 1.707435429096222 | 0.0008729009039302258 | 1.7066189050674438 | 1.708251953125 | 0.3564415574073791 | 0.002030279951199197 | 0.3545424044132232 | 0.358340710401535 | 0.3023426830768585 | 0.000350906290820105 | 0.3020144402980804 | 0.3026709258556366 | -9999.0 | 0.0 | -9999.0 | -9999.0 | -9999.0 | 0.0 | -9999.0 | -9999.0 | -9999.0 | 0.0 | -9999.0 | -9999.0 | 0.1042194217443466 | 8.294721469109035e-06 | 0.1042194217443466 | 0.1042373403906822 | 1.715789794921875 | 0.001402039007837862 | 1.715789794921875 | 1.7188185453414917 | 0.7188712954521179 | 0.0014949674798809447 | 0.7188712954521179 | 0.7221007943153381 | 1.970276951789856 | 0.018573843840262887 | 1.934388875961304 | 1.970276951789856 | 0.3608308732509613 | 0.004311563730231936 | 0.3608308732509613 | 0.3691616058349609 | 0.2941087782382965 | 0.0009687919419025886 | 0.2941087782382965 | 0.2959806621074676 | 0.4393351674079895 | 0.006024186034919744 | 0.4222961962223053 | 0.4393351674079895 | 1.1838626861572266 | 0.007396139710934239 | 1.1838626861572266 | 1.2047821283340454 | 0.5613290071487427 | 0.0019051429198136875 | 0.5613290071487427 | 0.5667175650596619 | 0.0910589918494224 | 0.0011538569058607675 | 0.0910589918494224 | 0.0943225920200347 | 1.6499500274658203 | 0.0059099153918944995 | 1.6332342624664309 | 1.6499500274658203 | 0.7046993374824524 | 0.0013654103777831785 | 0.7008373737335205 | 0.7046993374824524 | 0.0354578979313373 | 0.0 | 0.0354578979313373 | 0.0354578979313373 | 2.292947769165039 | 0.0 | 2.292947769165039 | 2.292947769165039 | 0.8771045207977295 | 0.0 | 0.8771045207977295 | 0.8771045207977295 | 3.52 | 2024-12-05 04:00:00 |