v0.4.28

Lux v0.4.28

Diff since v0.4.27

Closed issues:

• Nondeterministic method error for some gradients... (#159)

Merged pull requests:

• Make normalization typestable (#168) (@avik-pal)
• Add a manual page on precompilation (#169) (@avik-pal)
• Remove dead code and improve var for Tracker.jl support (#171) (@avik-pal)
• Hyper Network Example (#172) (@avik-pal)
• Modify mkdocs settings (#173) (@avik-pal)
• Make ViT work on GPUs (#174) (@avik-pal)
• Add sensible recurrent layer wrappers (#175) (@avik-pal)

v0.4.27

Lux v0.4.27

Diff since v0.4.26

Closed issues:

• Remaining Deprecations (#91)
• Proposal of Lux + Enzyme + CUDA differential programming example (#145)

Merged pull requests:

• Fix type stability in normalization implementation (#164) (@avik-pal)
• Add freeze tests to runtests (#166) (@avik-pal)
• Precompile common workflows + check invalidations (#167) (@avik-pal)

v0.4.26

Lux v0.4.26

Diff since v0.4.25

Merged pull requests:

• Add More Layers (#163) (@avik-pal)

v0.4.25

Lux v0.4.25

Diff since v0.4.24

Closed issues:

• Suboptimal GroupNorm Implementation on GPUs (#10)
• Generalize normalization to work for unconstrained types (#98)

Merged pull requests:

• Try relaxing JET version (#155) (@avik-pal)
• Update to use LuxLib (#156) (@avik-pal)
• Mark non differentiable code paths (#160) (@avik-pal)
• Fix generic GN dispatch for non 4D arrays (#161) (@avik-pal)
• Add dispatch for subarray (#162) (@avik-pal)

v0.4.24

Lux v0.4.24

Diff since v0.4.23

Closed issues:

• Allow dispatch on custom array types (#157)

Merged pull requests:

• Introducing LuxLib.jl: Effectively pullout some of the custom layer implementations from Lux.jl (#154) (@avik-pal)
• Allow dispatch using Lux.apply (#158) (@avik-pal)

v0.4.23

Lux v0.4.23

Diff since v0.4.22

Closed issues:

• How to avoid the activation function conversion (#152)

Merged pull requests:

• Allow controlling fast activation transformation (#153) (@avik-pal)

v0.4.22

Lux v0.4.22

Diff since v0.4.21

Closed issues:

• getindex for Chain (#131)

Merged pull requests:

• Fix CuArray -> Array rrule (#149) (@avik-pal)
• Allow indexing into Chains (#150) (@avik-pal)
• API for freezing layers (#151) (@avik-pal)

v0.4.21

Lux v0.4.21

Diff since v0.4.20

Closed issues:

• concat input and output of a layer (#146)

Merged pull requests:

• Update Imagenet example (#147) (@avik-pal)
• Make normalization more AD friendly (Diffractor) (#148) (@avik-pal)

v0.4.20

Lux v0.4.20

Diff since v0.4.19

Merged pull requests:

• Allow fmapping over the model (#144) (@avik-pal)

v0.4.19

Lux v0.4.19

Diff since v0.4.18

Closed issues:

• Named Layers for Container Types (#79)
• CUDNNError during backpropagation in simple CNN (#141)

Merged pull requests:

• Named Layers inside Generic Containers (#143) (@avik-pal)