for i in range(2):
p.inversions.iterate(
inverse_problem_configuration="my_inversion",
timeout_in_seconds=360,
ping_interval_in_seconds=10,
)
p.inversions.delete_disposable_files(
inverse_problem_configuration="my_inversion",
data_to_remove=["auxiliary", "gradients", "waveforms"],
)
[2024-07-02 14:15:21,349] INFO: Resuming iteration #1.
[2024-07-02 14:15:21,354] INFO: 1 new tasks have been issued.
[2024-07-02 14:15:21,357] INFO: Processing task `gradient`
[2024-07-02 14:15:21,966] INFO: Submitting job array with 5 jobs ...
Uploading 1 files...
Uploading 1 files...
Uploading 1 files...
Uploading 1 files...
Uploading 1 files...
[2024-07-02 14:15:22,134] INFO: Launched adjoint simulations for 5 events. Please check again to see if they are finished.
[2024-07-02 14:15:22,140] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2024-07-02 14:15:32,145] INFO: Processing task `gradient`
[2024-07-02 14:15:32,803] INFO: 5 events have already been submitted. They will not be submitted again.
[2024-07-02 14:15:33,606] INFO:
Iteration 1: Number of events: 5 chi = 0.006215537426211551 ||g|| = 0.009661534263313525
pred = -0.009679722626408399 ared = -0.011474538731562624 norm_update = 0.9534157084293066 tr_radius = 0.9534159053003332
[2024-07-02 14:15:33,623] INFO: 1 new tasks have been issued.
[2024-07-02 14:15:33,624] INFO: Processing task `preconditioner`
[2024-07-02 14:15:33,754] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2024-07-02 14:15:43,780] INFO: Processing task `preconditioner`
[2024-07-02 14:15:43,982] INFO: 1 new tasks have been issued.
[2024-07-02 14:15:43,983] INFO: Processing task `misfit`
[2024-07-02 14:15:44,123] INFO: Submitting job array with 5 jobs ...
[2024-07-02 14:15:44,329] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2024-07-02 14:15:44,332] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2024-07-02 14:15:54,431] INFO: Processing task `misfit`
[2024-07-02 14:15:55,553] INFO:
old misfit control group: 0.006215537426211551
new misfit control group: 0.004515145986994417
predicted reduction control group: -0.0008915795466015189
actual reduction control group: -0.001700391439217134
5 out of 5 event(s) improved the misfit.
[2024-07-02 14:15:55,554] INFO:
Model update accepted.
[2024-07-02 14:15:55,556] INFO: 1 new tasks have been issued.
[2024-07-02 14:15:55,562] INFO: Processing task `finalize_iteration`
[2024-07-02 14:15:55,708] INFO: Succesfully completed iteration #1.
[2024-07-02 14:15:55,713] INFO: Adding new iteration #2.
[2024-07-02 14:15:55,723] INFO: ... searching for obsolete files in project/INVERSIONS/my_inversion/00000
[2024-07-02 14:15:55,727] INFO: ... searching for obsolete files in project/INVERSIONS/my_inversion/00001
[2024-07-02 14:15:55,985] INFO: Freed up 6.0 MB of space.
[2024-07-02 14:15:55,991] INFO: Resuming iteration #2.
[2024-07-02 14:15:55,991] INFO: 1 new tasks have been issued.
[2024-07-02 14:15:55,992] INFO: Processing task `gradient`
[2024-07-02 14:15:56,674] INFO: Submitting job array with 5 jobs ...
Uploading 1 files...
Uploading 1 files...
Uploading 1 files...
Uploading 1 files...
Uploading 1 files...
[2024-07-02 14:15:56,877] INFO: Launched adjoint simulations for 5 events. Please check again to see if they are finished.
[2024-07-02 14:15:56,888] INFO: Some tasks of iteration #2 are still running. Please check again later.
[2024-07-02 14:16:06,904] INFO: Processing task `gradient`
[2024-07-02 14:16:07,259] INFO: 5 events have already been submitted. They will not be submitted again.
[2024-07-02 14:16:08,023] INFO:
Iteration 2: Number of events: 5 chi = 0.004515145986994417 ||g|| = 0.006397880517810244
pred = -0.0008915795466015189 ared = -0.001700391439217134 norm_update = 0.2218134244873827 tr_radius = 1.9068318106006663
[2024-07-02 14:16:08,057] INFO: 1 new tasks have been issued.
[2024-07-02 14:16:08,058] INFO: Processing task `preconditioner`
[2024-07-02 14:16:08,332] INFO: Some tasks of iteration #2 are still running. Please check again later.
[2024-07-02 14:16:18,378] INFO: Processing task `preconditioner`
[2024-07-02 14:16:18,613] INFO: 1 new tasks have been issued.
[2024-07-02 14:16:18,614] INFO: Processing task `misfit`
[2024-07-02 14:16:18,726] INFO: Submitting job array with 5 jobs ...
[2024-07-02 14:16:19,358] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2024-07-02 14:16:19,360] INFO: Some tasks of iteration #2 are still running. Please check again later.
[2024-07-02 14:16:29,586] INFO: Processing task `misfit`
[2024-07-02 14:16:31,001] INFO:
old misfit control group: 0.004515145986994417
new misfit control group: 0.0028780409841414486
predicted reduction control group: -0.0011415262560180658
actual reduction control group: -0.001637105002852968
5 out of 5 event(s) improved the misfit.
[2024-07-02 14:16:31,008] INFO:
Model update accepted.
[2024-07-02 14:16:31,014] INFO: 1 new tasks have been issued.
[2024-07-02 14:16:31,018] INFO: Processing task `finalize_iteration`
[2024-07-02 14:16:31,263] INFO: Succesfully completed iteration #2.
[2024-07-02 14:16:31,282] INFO: Adding new iteration #3.
[2024-07-02 14:16:31,359] INFO: ... searching for obsolete files in project/INVERSIONS/my_inversion/00000
[2024-07-02 14:16:31,366] INFO: ... searching for obsolete files in project/INVERSIONS/my_inversion/00001
[2024-07-02 14:16:31,669] INFO: ... searching for obsolete files in project/INVERSIONS/my_inversion/00002
[2024-07-02 14:16:31,968] INFO: Freed up 6.0 MB of space.