Input-output equivalence and identifiability: some simple generalizations of the differential algebra approach
In this paper, we give an overview of the differential algebra approach to identifiability, and then note a very simple observation about input-output equivalence and identifiability, that describes the identifiability equivalence between input-output equivalent models. We then give several simple consequences of this observation that can be useful in showing identifiability, including examining non-first order ODE models, nondimensionalization and rescaling, model reducibility, and a modular approach to evaluating identifiability. We also examine how input-output equivalence can allow us to generate input output equations in the differential algebra approach through a wider range of methods (e.g. substitution and differential or standard Groebner basis approaches).
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
GENNI: Visualising the Geometry of Equivalences for Neural Network Identifiability
We propose an efficient algorithm to visualise symmetries in neural networks. Typically, models are defined with respect to a parameter space, where non-equal parameters can produce the same input-output map. Our propose…
On the Non-Identifiability of Steering Vectors in Large Language Models
Activation steering methods are widely used to control large language model (LLM) behavior and are often interpreted as revealing meaningful internal representations. This interpretation assumes that steering directions …
Leveraging Task Structures for Improved Identifiability in Neural Network Representations
This work extends the theory of identifiability in supervised learning by considering the consequences of having access to a distribution of tasks. In such cases, we show that linear identifiability is achievable in the …
Representation LearningObject-centric architectures enable efficient causal representation learning
Causal representation learning has showed a variety of settings in which we can disentangle latent variables with identifiability guarantees (up to some reasonable equivalence class). Common to all of these approaches is…
DisentanglementObjectRepresentation LearningIdentifiable Object-Centric Representation Learning via Probabilistic Slot Attention
Learning modular object-centric representations is crucial for systematic generalization. Existing methods show promising object-binding capabilities empirically, but theoretical identifiability guarantees remain relativ…
ObjectRepresentation LearningSystematic Generalization