Refactor to make all algorithms use the same formats, simplify parallelism, direct pre-conditioning and produce uniformly blurred images#111

Merged

landmanbester merged 235 commits intomainfrom vertical_psi

Aug 30, 2024

+7,912-6,290

Commits on May 3, 2024

add option to visualise init graphs
landmanbester
committed
name jones ones
landmanbester
committed
clone t mapping in stokes2vis
landmanbester
committed
print visualised graph locations to log
landmanbester
committed

Commits on May 8, 2024

add jsk wavelets and initial approach to distribute spotless
landmanbester
committed

Commits on May 10, 2024

growing bytearray problem
landmanbester
committed
eliminate wavelets and cf.futures for testing
landmanbester
committed
band actor chaos
landmanbester
committed
images rst
landmanbester
committed
heading at the top
landmanbester
committed

Commits on May 13, 2024

unify gain-table and gain-term params in init
landmanbester
committed

Commits on May 14, 2024

simplified band actors approach
landmanbester
committed
residuals decreasing
landmanbester
committed

Commits on May 16, 2024

Add imit worker that combines init and grid steps (for use with distributed minors)
landmanbester
committed

Commits on May 17, 2024

cleaner distributed workflow
landmanbester
committed

Commits on May 20, 2024

add l2 reweighting to dist_spotless
landmanbester
committed
tweak when L2 reweighting happens
landmanbester
committed
add imit cab
landmanbester
committed
add missing xds_from_zarr import to imit
landmanbester
committed
allow diagonal jones in imit worker
landmanbester
committed
add unique keys for imit jobs, print scheduler address
landmanbester
committed
add key for reading in worker_client in stokes2im
landmanbester
committed
test to_zarr with no dask
landmanbester
committed
clone subds in imit
landmanbester
committed
direct to workers in imit client
landmanbester
committed

Commits on May 21, 2024

clone inside image_data_products
landmanbester
committed
set OMP_NUM_THREADS so wgridder can parallelise
landmanbester
committed
print update and ratio timings
landmanbester
committed
test communication times with direct_to_workers
landmanbester
committed

Commits on May 22, 2024

cache of imaging data products. allow worker compression
landmanbester
committed
numba ratio computation
landmanbester
committed
allow overwriting existing model
landmanbester
committed

Commits on May 23, 2024

allow fits output format for fastim worker
landmanbester
committed
add DATE-OBS to fits header
landmanbester
committed
add BDA support
landmanbester
committed
make sure ddsstore is initialised when overwriting
landmanbester
committed
norm wsum when writing fits out of fastim
landmanbester
committed
depend on uninneddeps qcal branch
landmanbester
committed
typo
landmanbester
committed
depend on codex-africanus >= 0.3.7
landmanbester
committed

Commits on May 26, 2024

Commits on May 27, 2024

Commits on May 30, 2024

make grid app compatible with init output
landmanbester
committed

Commits on Jun 5, 2024

Commits on Jun 6, 2024

also negate w in degrid
landmanbester
committed

Commits on Jun 9, 2024

Commits on Jun 10, 2024

overwrite restore products by default. Scale by pixel area. raise error if fastim future errs
landmanbester
committed

Commits on Jun 13, 2024

Commits on Jun 14, 2024

linear extrapolation in model2comps
landmanbester
committed

Commits on Jun 21, 2024

Commits on Jun 22, 2024

Commits on Jun 23, 2024

set crpix3 for MFS fits files
landmanbester
committed

Commits on Jun 24, 2024

Commits on Jun 25, 2024

unpin numba and prefer_literal in overload
landmanbester
committed

Commits on Jun 26, 2024

Commits on Jun 28, 2024

rewrite band_actor with precond and full hess
landmanbester
committed

Commits on Jun 29, 2024

Commits on Jun 30, 2024

Merge branch 'band_actors' into pcg_spotless
landmanbester
committed

Commits on Jul 1, 2024

Commits on Jul 3, 2024

remove nthreads-dask from hci and smoovie inputs
landmanbester
committed

Commits on Jul 6, 2024

fake client for testing
landmanbester
committed

Commits on Jul 8, 2024

Commits on Jul 9, 2024

get fluxmop working with new data structures
landmanbester
committed

Commits on Jul 10, 2024

make fluxmop reversible again
landmanbester
committed

Commits on Jul 11, 2024

start towards uniformly blurred image
landmanbester
committed

Commits on Jul 12, 2024

client interface in restore worker
landmanbester
committed

Commits on Jul 14, 2024

Commits on Jul 15, 2024

Commits on Jul 16, 2024

Commits on Jul 17, 2024

write fits to correct location in restore
landmanbester
committed

Commits on Jul 18, 2024

Commits on Jul 21, 2024

Commits on Jul 23, 2024

Commits on Jul 25, 2024

fix restore mess
landmanbester
committed

Commits on Jul 26, 2024

iterable pd-tol
landmanbester
committed

Commits on Jul 27, 2024

Commits on Jul 31, 2024

add ability to combine models in model2comps
landmanbester
committed

Commits on Aug 1, 2024

wait for futures when using restore worker
landmanbester
committed

Commits on Aug 2, 2024

add option to drop nearly null bands
landmanbester
committed

Commits on Aug 10, 2024

freq_factor when thresholding
landmanbester
committed

Commits on Aug 11, 2024

Commits on Aug 14, 2024

fix init bug when using multiple measurement sets without gain solutions. add concat-time option to hci worker
landmanbester
committed

Commits on Aug 15, 2024

Commits on Aug 16, 2024

Commits on Aug 20, 2024

add natural grad to hci
landmanbester
committed

Commits on Aug 21, 2024

Commits on Aug 23, 2024

fix bug when transferring model from comps
landmanbester
committed

Commits on Aug 24, 2024

cast model to double precision in stokes2im
landmanbester
committed

Commits on Aug 26, 2024

Commits on Aug 28, 2024

Commits on Aug 29, 2024

Commits on Aug 30, 2024