Run memory_profiler to find leaks and unnecessary allocations

[brendancol]

[giancastro]

@brendancol
The following is the memory report (pytest-memray), ordered in descending order by memory consumption.

mem_report.txt

[giancastro]

(pyrte_rrtmgp_dev) ➜  pyrte_rrtmgp git:(main) ✗ python -m pytest --memray  .
================================================================ test session starts =================================================================
platform darwin -- Python 3.12.9, pytest-8.3.5, pluggy-1.5.0
rootdir: /Users/giancastro/Projects/pyRTE-RRTMGP
configfile: pyproject.toml
plugins: anyio-4.8.0, line-profiler-0.2.1, memray-1.7.0, profiling-1.8.1, cov-6.1.1
collected 52 items

tests/test_basic_functionality.py .......................................                                                                      [ 75%]
tests/test_cld_lw_solver.py ..                                                                                                                 [ 78%]
tests/test_cld_sw_solver.py ..                                                                                                                 [ 82%]
tests/test_data_validation.py ....                                                                                                             [ 90%]
tests/test_lw_solver.py ...                                                                                                                    [ 96%]
tests/test_sw_solver.py ..                                                                                                                     [100%]


=================================================================== MEMRAY REPORT ====================================================================
Allocation results for pyrte_rrtmgp/tests/test_lw_solver.py::test_lw_solver_noscat_dask at the high watermark

	 📦 Total memory allocated: 2.4GiB
	 📏 Total allocations: 340
	 📊 Histogram of allocation sizes: |▃█▂▁▁|
	 🥇 Biggest allocating functions:
		- concatenate3:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/dask/array/core.py:5584 -> 895.3MiB
		- compute_planck_source:/Users/giancastro/Projects/pyRTE-RRTMGP/pyrte_rrtmgp/kernels/rrtmgp.py:212 -> 214.5MiB
		- compute_planck_source:/Users/giancastro/Projects/pyRTE-RRTMGP/pyrte_rrtmgp/kernels/rrtmgp.py:211 -> 210.9MiB
		- compute_tau_absorption:/Users/giancastro/Projects/pyRTE-RRTMGP/pyrte_rrtmgp/kernels/rrtmgp.py:350 -> 210.9MiB
		- from_array:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/dask/array/core.py:3677 -> 156.4MiB


Allocation results for pyrte_rrtmgp/tests/test_sw_solver.py::test_sw_solver_noscat_dask at the high watermark

	 📦 Total memory allocated: 1.9GiB
	 📏 Total allocations: 294
	 📊 Histogram of allocation sizes: |▃█▃▁▁|
	 🥇 Biggest allocating functions:
		- concatenate3:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/dask/array/core.py:5584 -> 270.4MiB
		- __call__:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/dask/_task_spec.py:755 -> 220.4MiB
		- from_array:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/dask/array/core.py:3677 -> 184.6MiB
		- from_array:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/dask/array/core.py:3677 -> 184.6MiB
		- __call__:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/dask/_task_spec.py:755 -> 166.1MiB


Allocation results for pyrte_rrtmgp/tests/test_data_validation.py::test_validate_problem_dataset_success at the high watermark

	 📦 Total memory allocated: 1.4GiB
	 📏 Total allocations: 177
	 📊 Histogram of allocation sizes: |█▃   |
	 🥇 Biggest allocating functions:
		- compute_planck_source:/Users/giancastro/Projects/pyRTE-RRTMGP/pyrte_rrtmgp/kernels/rrtmgp.py:212 -> 214.5MiB
		- empty_like:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/xarray/core/duck_array_ops.py:225 -> 214.5MiB
		- empty_like:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/xarray/core/duck_array_ops.py:225 -> 210.9MiB
		- compute_planck_source:/Users/giancastro/Projects/pyRTE-RRTMGP/pyrte_rrtmgp/kernels/rrtmgp.py:211 -> 210.9MiB
		- empty_like:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/xarray/core/duck_array_ops.py:225 -> 210.9MiB


Allocation results for pyrte_rrtmgp/tests/test_data_validation.py::test_raises_value_error_for_invalid_pressure at the high watermark

	 📦 Total memory allocated: 1.4GiB
	 📏 Total allocations: 148
	 📊 Histogram of allocation sizes: |█▂  ▁|
	 🥇 Biggest allocating functions:
		- empty_like:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/xarray/core/duck_array_ops.py:225 -> 214.5MiB
		- compute_planck_source:/Users/giancastro/Projects/pyRTE-RRTMGP/pyrte_rrtmgp/kernels/rrtmgp.py:212 -> 214.5MiB
		- compute_planck_source:/Users/giancastro/Projects/pyRTE-RRTMGP/pyrte_rrtmgp/kernels/rrtmgp.py:211 -> 210.9MiB
		- empty_like:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/xarray/core/duck_array_ops.py:225 -> 210.9MiB
		- empty_like:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/xarray/core/duck_array_ops.py:225 -> 210.9MiB


Allocation results for pyrte_rrtmgp/tests/test_data_validation.py::test_dask_validate_problem_dataset_success at the high watermark

	 📦 Total memory allocated: 565.0MiB
	 📏 Total allocations: 173
	 📊 Histogram of allocation sizes: |▅█▂▁ |
	 🥇 Biggest allocating functions:
		- from_array:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/dask/array/core.py:3677 -> 156.4MiB
		- _wrapfunc:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/numpy/_core/fromnumeric.py:57 -> 140.2MiB
		- from_array:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/dask/array/core.py:3677 -> 89.9MiB
		- empty_like:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/xarray/core/duck_array_ops.py:225 -> 65.9MiB
		- empty_like:/Users/giancastro/miniconda3/envs/pyrte_rrtmgp_dev/lib/python3.12/site-packages/xarray/core/duck_array_ops.py:225 -> 33.0MiB


================================================================ 52 passed in 26.78s =================================================================

[brendancol]

#193