gradient-descent-optimizer

Pieces of code for the experiments described in the manuscript "Optimizing Variational Physics-Informed Neural Networks Using Least Squares", available at https://arxiv.org/pdf/2407.20417.

Multivariate Regression and Classification Using a Feed-Forward Neural Network and Gradient Descent Optimization.

Python code for visualizing Gradient Descent optimization paths with animated contours. Demonstrates two strategies: fixed and optimal step sizes. Includes Fibonacci search for step size and data saved with Pickle.

Multivariate Linear and Logistic Regression Using Gradient Descent Optimization.