for i in range(2):
p.inversions.iterate(
inverse_problem_configuration="my_second_inversion",
timeout_in_seconds=360,
ping_interval_in_seconds=10,
)
p.inversions.delete_disposable_files(
inverse_problem_configuration="my_second_inversion",
data_to_remove=["auxiliary", "gradients", "waveforms"],
)
p.viz.nb.inversion(inverse_problem_configuration="my_second_inversion")
[2023-09-10 18:42:29,031] INFO: Resuming iteration #1.
[2023-09-10 18:42:29,032] INFO: 1 new tasks have been issued.
[2023-09-10 18:42:29,033] INFO: Processing task `gradient`
[2023-09-10 18:42:29,722] INFO: Submitting job array with 5 jobs ...
[2023-09-10 18:42:29,908] INFO: Launched adjoint simulations for 5 events. Please check again to see if they are finished.
[2023-09-10 18:42:29,911] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2023-09-10 18:42:39,926] INFO: Processing task `gradient`
[2023-09-10 18:42:40,357] INFO: 5 events have already been submitted. They will not be submitted again.
[2023-09-10 18:42:41,449] INFO:
Iteration 1: Number of events: 5 chi = 0.006645707057577022 ||g|| = 0.008122034993532758
pred = -0.005735007567861612 ared = -0.011044118213677406 norm_update = 0.7265202727548425 tr_radius = 0.7265203173393829
[2023-09-10 18:42:41,475] INFO: 1 new tasks have been issued.
[2023-09-10 18:42:41,480] INFO: Processing task `preconditioner`
[2023-09-10 18:42:41,740] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2023-09-10 18:42:51,798] INFO: Processing task `preconditioner`
[2023-09-10 18:42:52,096] INFO: 1 new tasks have been issued.
[2023-09-10 18:42:52,097] INFO: Processing task `misfit`
[2023-09-10 18:42:52,260] INFO: Submitting job array with 5 jobs ...
[2023-09-10 18:42:52,565] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2023-09-10 18:42:52,573] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2023-09-10 18:43:02,666] INFO: Processing task `misfit`
[2023-09-10 18:43:03,988] INFO:
old misfit control group: 0.006645707057577022
new misfit control group: 0.002896766734466043
predicted reduction control group: -0.0027947391349793975
actual reduction control group: -0.003748940323110979
5 out of 5 event(s) improved the misfit.
[2023-09-10 18:43:03,991] INFO:
Model update accepted.
[2023-09-10 18:43:03,994] INFO: 1 new tasks have been issued.
[2023-09-10 18:43:03,998] INFO: Processing task `finalize_iteration`
[2023-09-10 18:43:04,157] INFO: Succesfully completed iteration #1.
[2023-09-10 18:43:04,163] INFO: Adding new iteration #2.
[2023-09-10 18:43:04,184] INFO: ... searching for obsolete files in project/INVERSIONS/my_second_inversion/00000
[2023-09-10 18:43:04,195] INFO: ... searching for obsolete files in project/INVERSIONS/my_second_inversion/00001
[2023-09-10 18:43:04,564] INFO: Freed up 6.0 MB of space.
[2023-09-10 18:43:04,572] INFO: Resuming iteration #2.
[2023-09-10 18:43:04,574] INFO: 1 new tasks have been issued.
[2023-09-10 18:43:04,575] INFO: Processing task `gradient`
[2023-09-10 18:43:05,241] INFO: Submitting job array with 5 jobs ...
[2023-09-10 18:43:05,455] INFO: Launched adjoint simulations for 5 events. Please check again to see if they are finished.
[2023-09-10 18:43:05,463] INFO: Some tasks of iteration #2 are still running. Please check again later.
[2023-09-10 18:43:15,482] INFO: Processing task `gradient`
[2023-09-10 18:43:15,874] INFO: 5 events have already been submitted. They will not be submitted again.
[2023-09-10 18:43:16,933] INFO:
Iteration 2: Number of events: 5 chi = 0.0028967667344660434 ||g|| = 0.003362121843820212
pred = -0.0027947391349793975 ared = -0.003748940323110979 norm_update = 0.7176639107602372 tr_radius = 1.4530406346787659
[2023-09-10 18:43:16,962] INFO: 1 new tasks have been issued.
[2023-09-10 18:43:16,963] INFO: Processing task `preconditioner`
[2023-09-10 18:43:17,269] INFO: Some tasks of iteration #2 are still running. Please check again later.
[2023-09-10 18:43:27,370] INFO: Processing task `preconditioner`
[2023-09-10 18:43:27,660] INFO: 1 new tasks have been issued.
[2023-09-10 18:43:27,662] INFO: Processing task `misfit`
[2023-09-10 18:43:28,066] INFO: Submitting job array with 5 jobs ...
[2023-09-10 18:43:28,321] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2023-09-10 18:43:28,324] INFO: Some tasks of iteration #2 are still running. Please check again later.
[2023-09-10 18:43:38,434] INFO: Processing task `misfit`
[2023-09-10 18:43:40,237] INFO:
old misfit control group: 0.002896766734466043
new misfit control group: 0.002407847089641693
predicted reduction control group: -0.00022036388532600842
actual reduction control group: -0.0004889196448243502
5 out of 5 event(s) improved the misfit.
[2023-09-10 18:43:40,238] INFO:
Model update accepted.
[2023-09-10 18:43:40,238] INFO: 1 new tasks have been issued.
[2023-09-10 18:43:40,239] INFO: Processing task `finalize_iteration`
[2023-09-10 18:43:40,444] INFO: Succesfully completed iteration #2.
[2023-09-10 18:43:40,452] INFO: Adding new iteration #3.
[2023-09-10 18:43:40,475] INFO: ... searching for obsolete files in project/INVERSIONS/my_second_inversion/00000
[2023-09-10 18:43:40,482] INFO: ... searching for obsolete files in project/INVERSIONS/my_second_inversion/00001
[2023-09-10 18:43:40,669] INFO: ... searching for obsolete files in project/INVERSIONS/my_second_inversion/00002
[2023-09-10 18:43:40,996] INFO: Freed up 6.0 MB of space.
