We study dynamical Galerkin schemes for evolutionary partial differential equations (PDEs), where the projection operator changes over time. When selecting a subset of basis functions, the projection operator is non-differentiable in time and an integral formulation has to be used. We analyze the projected equations with respect to existence and uniqueness of the solution and prove that non-smooth projection operators introduce dissipation, a result which is crucial for adaptive discretizations of PDEs, e.g., adaptive wavelet methods. For the Burgers equation we illustrate numerically that thresholding the wavelet coefficients, and thus changing the projection space, will indeed introduce dissipation of energy. We discuss consequences for the so-called `pseudo-adaptive' simulations, where time evolution and dealiasing are done in Fourier space, whilst thresholding is carried out in wavelet space. Numerical examples are given for the inviscid Burgers equation in 1D and the incompressible Euler equations in 2D and 3D.
We consider a class of statistical estimation problems in which we are given a random data matrix ${\boldsymbol X}\in {\mathbb R}^{n\times d}$ (and possibly some labels ${\boldsymbol y}\in{\mathbb R}^n$) and would like to estimate a coefficient vector ${\boldsymbol \theta}\in{\mathbb R}^d$ (or possibly a constant number of such vectors). Special cases include low-rank matrix estimation and regularized estimation in generalized linear models (e.g., sparse regression). First order methods proceed by iteratively multiplying current estimates by ${\boldsymbol X}$ or its transpose. Examples include gradient descent or its accelerated variants. Celentano, Montanari, Wu proved that for any constant number of iterations (matrix vector multiplications), the optimal first order algorithm is a specific approximate message passing algorithm (known as `Bayes AMP'). The error of this estimator can be characterized in the high-dimensional asymptotics $n,d\to\infty$, $n/d\to\delta$, and provides a lower bound to the estimation error of any first order algorithm. Here we present a simpler proof of the same result, and generalize it to broader classes of data distributions and of first order algorithms, including algorithms with non-separable nonlinearities. Most importantly, the new proof technique does not require to construct an equivalent tree-structured estimation problem, and is therefore susceptible of a broader range of applications.
In this article we develop the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) for elliptic partial differential equations with inhomogeneous Dirichlet, Neumann, and Robin boundary conditions, and the high contrast property emerges from the coefficients of elliptic operators and Robin boundary conditions. By careful construction of multiscale bases of the CEM-GMsFEM, we introduce two operators $\mathcal{D}^m$ and $\mathcal{N}^m$ which are used to handle inhomogeneous Dirichlet and Neumann boundary values and are also proved to converge independently of contrast ratios as enlarging oversampling regions. We provide a priori error estimate and show that oversampling layers are the key factor in controlling numerical errors. A series of experiments are conducted, and those results reflect the reliability of our methods even with high contrast ratios.
We develop two adaptive discretization algorithms for convex semi-infinite optimization, which terminate after finitely many iterations at approximate solutions of arbitrary precision. In particular, they terminate at a feasible point of the considered optimization problem. Compared to the existing finitely feasible algorithms for general semi-infinite optimization problems, our algorithms work with considerably smaller discretizations and are thus computationally favorable. Also, our algorithms terminate at approximate solutions of arbitrary precision, while for general semi-infinite optimization problems the best possible approximate-solution precision can be arbitrarily bad. All occurring finite optimization subproblems in our algorithms have to be solved only approximately, and continuity is the only regularity assumption on our objective and constraint functions. Applications to parametric and non-parametric regression problems under shape constraints are discussed.
We introduce a new numerical method for solving time-harmonic acoustic scattering problems. The main focus is on plane waves scattered by smoothly varying material inhomogeneities. The proposed method works for any frequency $\omega$, but is especially efficient for high-frequency problems. It is based on a time-domain approach and consists of three steps: \emph{i)} computation of a suitable incoming plane wavelet with compact support in the propagation direction; \emph{ii)} solving a scattering problem in the time domain for the incoming plane wavelet; \emph{iii)} reconstruction of the time-harmonic solution from the time-domain solution via a Fourier transform in time. An essential ingredient of the new method is a front-tracking mesh adaptation algorithm for solving the problem in \emph{ii)}. By exploiting the limited support of the wave front, this allows us to make the number of the required degrees of freedom to reach a given accuracy significantly less dependent on the frequency $\omega$. We also present a new algorithm for computing the Fourier transform in \emph{iii)} that exploits the reduced number of degrees of freedom corresponding to the adapted meshes. Numerical examples demonstrate the advantages of the proposed method and the fact that the method can also be applied with external source terms such as point sources and sound-soft scatterers. The gained efficiency, however, is limited in the presence of trapping modes.
We present a discontinuous Galerkin internal-penalty scheme that is applicable to a large class of linear and nonlinear elliptic partial differential equations. The unified scheme can accommodate all second-order elliptic equations that can be formulated in first-order flux form, encompassing problems in linear elasticity, general relativity, and hydrodynamics, including problems formulated on a curved manifold. It allows for a wide range of linear and nonlinear boundary conditions, and accommodates curved and nonconforming meshes. Our generalized internal-penalty numerical flux and our Schur-complement strategy of eliminating auxiliary degrees of freedom make the scheme compact without requiring equation-specific modifications. We demonstrate the accuracy of the scheme for a suite of numerical test problems. The scheme is implemented in the open-source SpECTRE numerical relativity code.
In this paper we study some theoretical and numerical issues of the Boussinesq/Full dispersion system. This is a a three-parameter system of pde's that models the propagation of internal waves along the interface of two-fluid layers with rigid lid condition for the upper layer, and under a Boussinesq regime for the upper layer and a full dispersion regime for the lower layer. We first discretize in space the periodic initial-value problem with a Fourier-Galerkin spectral method and prove error estimates for several ranges of values of the parameters. Solitary waves of the model systems are then studied numerically in several ways. The numerical generation is analyzed by approximating the ode system with periodic boundary conditions for the solitary-wave profiles with a Fourier spectral scheme, implemented in a collocation form, and solving iteratively the corresponding algebraic system in Fourier space with the Petviashvili method accelerated with the minimal polynomial extrapolation technique. Motivated by the numerical results, a new result of existence of solitary waves is proved. In the last part of the paper, the dynamics of these solitary waves is studied computationally, To this end, the semidiscrete systems obtained from the Fourier-Galerkin discretization in space are integrated numerically in time by a Runge-Kutta Composition method of order four. The fully discrete scheme is used to explore numerically the stability of solitary waves, their collisions, and the resolution of other initial conditions into solitary waves.
In the $(1+\varepsilon,r)$-approximate near-neighbor problem for curves (ANNC) under some distance measure $\delta$, the goal is to construct a data structure for a given set $\mathcal{C}$ of curves that supports approximate near-neighbor queries: Given a query curve $Q$, if there exists a curve $C\in\mathcal{C}$ such that $\delta(Q,C)\le r$, then return a curve $C'\in\mathcal{C}$ with $\delta(Q,C')\le(1+\varepsilon)r$. There exists an efficient reduction from the $(1+\varepsilon)$-approximate nearest-neighbor problem to ANNC, where in the former problem the answer to a query is a curve $C\in\mathcal{C}$ with $\delta(Q,C)\le(1+\varepsilon)\cdot\delta(Q,C^*)$, where $C^*$ is the curve of $\mathcal{C}$ closest to $Q$. Given a set $\mathcal{C}$ of $n$ curves, each consisting of $m$ points in $d$ dimensions, we construct a data structure for ANNC that uses $n\cdot O(\frac{1}{\varepsilon})^{md}$ storage space and has $O(md)$ query time (for a query curve of length $m$), where the similarity between two curves is their discrete Fr\'echet or dynamic time warping distance. Our method is simple to implement, deterministic, and results in an exponential improvement in both query time and storage space compared to all previous bounds. Further, we also consider the asymmetric version of ANNC, where the length of the query curves is $k \ll m$, and obtain essentially the same storage and query bounds as above, except that $m$ is replaced by $k$. Finally, we apply our method to a version of approximate range counting for curves and achieve similar bounds.
In this article, we propose a higher order approximation to Caputo fractional (C-F) derivative using graded mesh and standard central difference approximation for space derivatives, in order to obtain the approximate solution of time fractional partial differential equations (TFPDE). The proposed approximation for C-F derivative tackles the singularity at origin effectively and is easily applicable to diverse problems. The stability analysis and truncation error bounds of the proposed scheme are discussed, along with this, analyzed the required regularity of the solution. Few numerical examples are presented to support the theory.
Element Method. The Finite Volume Method guarantees local and global mass conservation. A property not satisfied by the Finite Volume Method. On the down side, the Finite Volume Method requires non trivial modifications to attain high order approximations unlike the Finite Volume Method. It has been contended that the Discontinuous Galerkin Method, locally conservative and high order, is a natural progression for Coastal Ocean Modeling. Consequently, as a primer we consider the vertical ocean-slice model with the inclusion of density effects. To solve these non steady Partial Differential Equations, we develop a pressure projection method for solution. We propose a Hybridized Discontinuous Galerkin solution for the required Poisson Problem in each time step. The purpose, is to reduce the computational cost of classical applications of the Discontinuous Galerkin method. The Hybridized Discontinuous Galerkin method is first presented as a general elliptic problem solver. It is shown that a high order implementation yields fast and accurate approximations on coarse meshes.
This paper presents and analyzes a discontinuous Galerkin method for the incompressible three-phase flow problem in porous media. We use a first order time extrapolation which allows us to solve the equations implicitly and sequentially. We show that the discrete problem is well-posed, and obtain a priori error estimates. Our numerical results validate the theoretical results, i.e. the algorithm converges with first order.