# Maximum Moment Restriction for Instrumental Variable Regression

@article{Zhang2020MaximumMR, title={Maximum Moment Restriction for Instrumental Variable Regression}, author={Rui Zhang and Masaaki Imaizumi and Bernhard Scholkopf and Krikamol Muandet}, journal={ArXiv}, year={2020}, volume={abs/2010.07684} }

We propose a simple framework for nonlinear instrumental variable (IV) regression based on a kernelized conditional moment restriction (CMR) known as a maximum moment restriction (MMR). The MMR is formulated by maximizing the interaction between the residual and functions of IVs that belong to a unit ball of reproducing kernel Hilbert space (RKHS). This allows us to tackle the IV regression as an empirical risk minimization where the risk depends on the reproducing kernel on the instrument and… Expand

#### 7 Citations

Proximal Causal Learning with Kernels: Two-Stage Estimation and Moment Restriction

- Computer Science
- ICML
- 2021

This work proposes two kernel-based methods for nonlinear causal effect estimation in the presence of unobserved confounding, and provides consistency guarantees for each algorithm, and demonstrates these approaches achieve competitive results on synthetic data and data simulating a real-world task. Expand

Instrument Space Selection for Kernel Maximum Moment Restriction

- Computer Science
- ArXiv
- 2021

This work presents a systematic way to select the instrument space for parameter estimation based on a principle of the least identifiable instrument space (LIIS) that identifies model parameters with the least space complexity. Expand

A causal view on compositional data

- Computer Science, Biology
- ArXiv
- 2021

This work provides a causal view on compositional data in an instrumental variable setting where the composition acts as the cause and advocates for multivariate alternatives using statistical data transformations and regression techniques that take the special structure of the compositional sample space into account. Expand

Causal Inference Under Unmeasured Confounding With Negative Controls: A Minimax Learning Approach

- Computer Science, Mathematics
- ArXiv
- 2021

This paper tackles the primary challenge to causal inference using negative controls: the identification and estimation of these bridge functions, and provides a new identification strategy that avoids both uniqueness and completeness. Expand

Learning Causal Relationships from Conditional Moment Conditions by Importance Weighting

- Computer Science, Economics
- ArXiv
- 2021

A method is proposed that transforms conditional moment conditions to unconditional moment conditions through importance weighting using the conditional density ratio, and proposes a method that successfully approximates conditional moments conditions. Expand

Scalable Quasi-Bayesian Inference for Instrumental Variable Regression

- Computer Science, Mathematics
- ArXiv
- 2021

This work presents a scalable quasi-Bayesian procedure for IV regression, building upon the recently developed kernelized IV models, and leads to a scalable approximate inference algorithm with time cost comparable to the corresponding point estimation methods. Expand

Testability of Reverse Causality without Exogeneous Variation

- Economics
- 2021

This paper shows that testability of reverse causality is possible even in the absence of exogenous variation, such as in the form of instrumental variables. Instead of relying on exogenous… Expand

#### References

SHOWING 1-10 OF 64 REFERENCES

Deep Generalized Method of Moments for Instrumental Variable Analysis

- Mathematics, Computer Science
- NeurIPS
- 2019

This paper proposes the DeepGMM algorithm, a new variational reformulation of GMM with optimal inverse-covariance weighting that allows us to efficiently control very many moment conditions and develops practical techniques for optimization and model selection that make it particularly successful in practice. Expand

Kernel Conditional Moment Test via Maximum Moment Restriction

- Mathematics, Computer Science
- UAI
- 2020

It is shown that the MMR not only fully characterizes the original conditional moment restrictions, leading to consistency in both hypothesis testing and parameter estimation, but also has an analytic expression that is easy to compute as well as closed-form asymptotic distributions. Expand

Kernel Instrumental Variable Regression

- Computer Science, Mathematics
- NeurIPS
- 2019

KIV is proposed, a nonparametric generalization of 2SLS, modeling relations among X, Y, and Z as nonlinear functions in reproducing kernel Hilbert spaces (RKHSs), and it is proved the consistency of KIV under mild assumptions, and conditions under which convergence occurs at the minimax optimal rate for unconfounded, single-stage RKHS regression. Expand

Instrumental Variable Estimation with the R Package ivtools

- Mathematics
- Epidemiologic Methods
- 2019

Abstract Instrumental variables is a popular method in epidemiology and related fields, to estimate causal effects in the presence of unmeasured confounding. Traditionally, instrumental variable… Expand

Minimax Estimation of Conditional Moment Models

- Mathematics, Economics
- NeurIPS
- 2020

This work develops an approach for estimating models described via conditional moment restrictions, and introduces a min-max criterion function, under which the estimation problem can be thought of as solving a zero-sum game between a modeler who is optimizing over the hypothesis space of the target model and an adversary who identifies violating moments over a test function space. Expand

Efficient Estimation of Models with Conditional Moment Restrictions Containing Unknown Functions

- Mathematics
- 2003

We propose an estimation method for models of conditional moment restrictions, which contain finite dimensional unknown parameters (theta) and infinite dimensional unknown functions (h). Our proposal… Expand

Nonparametric methods for inference in the presence of instrumental variables

- Mathematics
- 2003

We suggest two nonparametric approaches, based on kernel methods and orthogonal series, respectively, to estimating regression functions in the presence of instrumental variables. For the first time… Expand

Dual Instrumental Variable Regression

- Computer Science, Mathematics
- NeurIPS
- 2020

Inspired by problems in stochastic programming, it is shown that the two-stage procedure for nonlinear IV regression can be reformulated as a convex-concave saddle-point problem. Expand

Estimation of Nonparametric Conditional Moment Models with Possibly Nonsmooth Generalized Residuals

- Mathematics
- 2011

This paper studies nonparametric estimation of conditional moment restrictions in which the generalized residual functions can be nonsmooth in the unknown functions of endogenous variables. This is a… Expand

Instrumental Variable Analysis in Epidemiologic Studies: An Overview of the Estimation Methods

- Computer Science
- 2015

It is found that two-stage least squares is the method of first choice if exposure and outcome are both continuous and show a linear relation, and in case of a nonlinear relation, two- stage residual inclusion may be a suitable alternative. Expand