Skip to content

docs: add 3rd order AD example using Reactant#1097

Open
avik-pal wants to merge 1 commit intomainfrom
ap/nested_ad_reactant
Open

docs: add 3rd order AD example using Reactant#1097
avik-pal wants to merge 1 commit intomainfrom
ap/nested_ad_reactant

Conversation

@avik-pal
Copy link
Member

@avik-pal avik-pal commented Nov 20, 2024

fixes #614 #1094

Not yet functional

@avik-pal avik-pal force-pushed the ap/nested_ad_reactant branch 3 times, most recently from 7a49ff1 to 315426b Compare November 22, 2024 22:51
@avik-pal avik-pal force-pushed the ap/nested_ad_reactant branch from 315426b to a71f40a Compare January 4, 2025 02:37
@avik-pal avik-pal force-pushed the ap/nested_ad_reactant branch from a71f40a to 1378a9c Compare January 24, 2025 02:16
@avik-pal avik-pal force-pushed the ap/nested_ad_reactant branch from 1378a9c to 63b5d52 Compare March 7, 2025 21:31
@avik-pal avik-pal changed the base branch from main to ap/tracing_statefullayers March 7, 2025 21:31
Base automatically changed from ap/tracing_statefullayers to main March 7, 2025 21:54
@avik-pal avik-pal force-pushed the ap/nested_ad_reactant branch from 63b5d52 to 2c40b8f Compare March 7, 2025 21:55
@avik-pal
Copy link
Member Author

avik-pal commented Apr 5, 2025

I noticed users ran into an issue where this takes too long to compile, that is because this is trying to do gradient of the 2nd total derivative, which is expected to be slow (at least based on how this PR implements it).

For simple 3rd order, i.e. gradient(gradient(gradient, this is not really an ideal example and Reactant natively works quite well there

@avik-pal avik-pal force-pushed the ap/nested_ad_reactant branch from 2c40b8f to e38be45 Compare November 2, 2025 15:25
@codecov
Copy link

codecov bot commented Nov 2, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 37.16%. Comparing base (a2167f2) to head (1de1c52).

⚠️ Current head 1de1c52 differs from pull request most recent head 3242cb1

Please upload reports for the commit 3242cb1 to get more accurate results.

❗ There is a different number of reports uploaded between BASE (a2167f2) and HEAD (1de1c52). Click for more details.

HEAD has 50 uploads less than BASE
Flag BASE (a2167f2) HEAD (1de1c52)
51 1
Additional details and impacted files
@@             Coverage Diff             @@
##             main    #1097       +/-   ##
===========================================
- Coverage   82.53%   37.16%   -45.38%     
===========================================
  Files         168       61      -107     
  Lines        6957     2882     -4075     
===========================================
- Hits         5742     1071     -4671     
- Misses       1215     1811      +596     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@avik-pal avik-pal force-pushed the ap/nested_ad_reactant branch 2 times, most recently from df7b809 to 9d75226 Compare January 3, 2026 02:57
@avik-pal avik-pal force-pushed the ap/nested_ad_reactant branch 3 times, most recently from d6c7245 to 07bcf49 Compare January 25, 2026 21:45
@avik-pal avik-pal marked this pull request as ready for review January 25, 2026 21:45
@avik-pal avik-pal force-pushed the ap/nested_ad_reactant branch from 07bcf49 to 15bddaf Compare January 29, 2026 18:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ArgumentError in Lux.jl with GPU-Accelerated Neural Network Using LuxCUDA and Zygote [3rd Order AD] Pullback over twice Jacobian

1 participant