A comprehensive and FAIR comparison between MLP and KAN representations for differential equations and operator networks
Kolmogorov-Arnold Networks (KANs) were recently introduced as an alternative representation model to MLP. Herein, we employ KANs to construct physics-informed machine learning models (PIKANs) and deep operator models (DeepOKANs) for solving differential equations for forward and inverse problems. In particular, we compare them with physics-informed neural networks (PINNs) and deep operator networks (DeepONets), which are based on the standard MLP representation. We find that although the original KANs based on the B-splines parameterization lack accuracy and efficiency, modified versions based on low-order orthogonal polynomials have comparable performance to PINNs and DeepONet although they still lack robustness as they may diverge for different random seeds or higher order orthogonal polynomials. We visualize their corresponding loss landscapes and analyze their learning dynamics using information bottleneck theory. Our study follows the FAIR principles so that other researchers can use our benchmarks to further advance this emerging topic.
Code (0)
등록된 구현이 없습니다.
Tasks
Kolmogorov-Arnold NetworksPhysics-informed machine learningSimilar Papers 제목 키워드 기반
A Comparison of Differential Performance Metrics for the Evaluation of Automatic Speaker Verification Fairness
When decisions are made and when personal data is treated by automated processes, there is an expectation of fairness -- that members of different demographic groups receive equitable treatment. This expectation applies …
Face RecognitionFairnessSpeaker VerificationFair NLP Models with Differentially Private Text Encoders
Encoded text representations often capture sensitive attributes about individuals (e.g., race or gender), which raise privacy concerns and can make downstream models unfair to certain groups. In this work, we propose FED…
FairnessFair NLP Models with Differentially Private Text Encoders
Encoded text representations often capture sensitive attributes about individuals (e.g., gender, race, or age), which can raise privacy concerns and contribute to making downstream models unfair to certain groups. In thi…
FairnessComprehensive Studies for Arbitrary-shape Scene Text Detection
Numerous scene text detection methods have been proposed in recent years. Most of them declare they have achieved state-of-the-art performances. However, the performance comparison is unfair, due to lots of inconsistent …
Scene Text DetectionText DetectionSRBench: A Comprehensive Benchmark for Sequential Recommendation with Large Language Models
LLM development has aroused great interest in Sequential Recommendation (SR) applications. However, comprehensive evaluation of SR models remains lacking due to the limitations of the existing benchmarks: 1) an overempha…
Sequential RecommendationPrompt Engineering