Commit 7323a0a
committed
Implement out-of-core mapmaking
Using the previously implemented loader pattern, support on demand
loading of observation data when accumulating hits, inverse
covariance, and noise weighted maps for each observation.
- Add PipelineLoader class, which implements a loader which runs
a Pipeline to generate data for an observation. This can be
used to simulate data on demand, one observation at a time.
- Add AccumulateObservation operator, which can accumulate and
cache or load per-observation map domain products. This allows
building RHS map domain objects without keeping all detector
data in memory, and also allows computing the RHS on smaller
jobs which are I/O bound.
- Change the BinMap operator to use this new accumulation
technique.
Use new pixel io interfaces
WIP porting mapmaking utils to new accumulation
Large WIP on per-obs accumulation with optional cache and load.1 parent 4fc144d commit 7323a0a
File tree
49 files changed
+4553
-2003
lines changed- packaging/conda
- src/toast
- config
- io
- ops
- mapmaker_utils
- scripts
- templates
- offset
- tests
- helpers
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
49 files changed
+4553
-2003
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| 7 | + | |
7 | 8 | | |
8 | 9 | | |
9 | 10 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
325 | 325 | | |
326 | 326 | | |
327 | 327 | | |
| 328 | + | |
328 | 329 | | |
329 | 330 | | |
330 | 331 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
141 | 141 | | |
142 | 142 | | |
143 | 143 | | |
| 144 | + | |
144 | 145 | | |
145 | 146 | | |
146 | 147 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
| 12 | + | |
12 | 13 | | |
13 | 14 | | |
14 | 15 | | |
| |||
0 commit comments