In this article, we study the problem of minimizing the sum of potentially nondifferentiable convex cost functions with partially overlapping dependences in an asynchronous manner, where communication in the network is not coordinated. We study the behavior of an asynchronous algorithm based on dual decomposition and block coordinate subgradient methods under assumptions weaker than those used in the literature. At the same time, we allow different agents to use local stepsizes with no global coordination. Sufficient conditions are provided for almost sure convergence to the solution of the optimization problem. Under additional assumptions, we establish a sublinear convergence rate that, in turn, can be strengthened to the linear convergence rate if the problem is strongly convex and has Lipschitz gradients. We also extend available results in the literature by allowing multiple and potentially overlapping blocks to be updated at the same time with nonuniform and potentially time-varying probabilities assigned to different blocks. A numerical example is provided to illustrate the effectiveness of the algorithm.

We study emulation-based stabilisation of nonlinear networked control systems communicating over multiple wireless channels subject to packet loss. Specifically, we establish sufficient conditions on the rate of transmission that guarantee ℒp stability-in-expectation of the overall closed-loop system. These conditions depend on the cumulative dropout probability of the network nodes for static protocols. We use the obtained stability results to study power control, where we show there are interesting trade-offs between the transmission rate, transmit power, and stability. Lastly, numerical examples are presented to illustrate our results.

We propose a unifying emulation-based design framework for the event-triggered control of nonlinear systems that is based on a hybrid small-gain perspective. We show that various existing event-triggered controllers fit the unifying perspective. Moreover, we demonstrate that the flexibility offered by our approach can be used for the development of novel event-triggered schemes and for a systematic modification and improvement of existing schemes. Finally, we illustrate via a simulation example that these novel and/or modified event-triggered controllers can lead to a reduction in the required number of transmissions, while still guaranteeing the same stability properties.

Minimum attention control proposed by Brockett is an important formulation for resource-aware control, while his problem formulation and the underlying optimization problem that he proposed is in general very hard. In this paper, we propose a computationally tractable design method of minimum attention control based on promoting sparsity of the derivative of control. The optimal control problem is formulated as L0 norm minimization of the time derivative of control under the constraint that the derivative is bounded by a fixed value. This is a non-convex problem, and we propose L1 relaxation for linear systems to obtain optimal control by efficient numerical computation. We then show equivalence theorems between the L0 and L1 optimal controls. Also, we present an example of feedback control for the first-order integrator, that illustrates the proposed methodology.

This paper studies the behaviour of observers for the slow states of a general singularly perturbed system – that is a singularly perturbed system which has boundary-layer solutions that do not necessarily converge to a slow manifold. The solutions of the boundary-layer system are allowed to exhibit persistent (e.g. oscillatory) steady-state behaviour which are averaged to obtain the dynamics of the approximate slow system. It is shown that if an observer has certain properties such as asymptotic stability of its error dynamics on average, then it is practically asymptotically stable for the original singularly perturbed system.

Value iteration (VI) is a ubiquitous algorithm for optimal control, planning, and reinforcement learning schemes. Under the right assumptions, VI is a vital tool to generate inputs with desirable properties for the controlled system, like optimality and Lyapunov stability. As VI usually requires an infinite number of iterations to solve general nonlinear optimal control problems, a key question is when to terminate the algorithm to produce a "good" solution, with a measurable impact on optimality and stability guarantees. By carefully analysing VI under general stabilizability and detectability properties, we provide explicit and novel relationships of the stopping criterion's impact on near-optimality, stability and performance, thus allowing to tune these desirable properties against the induced computational cost. The considered class of stopping criteria encompasses those encountered in the control, dynamic programming and reinforcement learning literature and it allows considering new ones, which may be useful to further reduce the computational cost while endowing and satisfying stability and near-optimality properties. We therefore lay a foundation to endow machine learning schemes based on VI with stability and performance guarantees, while reducing computational complexity.

We study numerical optimisation algorithms that use zeroth-order information to minimise time-varying geodesically-convex cost functions on Riemannian manifolds. In the Euclidean setting, zeroth-order algorithms have received a lot of attention in both the time-varying and time-invariant cases. However, the extension to Riemannian manifolds is much less developed. We focus on Hadamard manifolds, which are a special class of Riemannian manifolds with global nonpositive curvature that offer convenient grounds for the generalisation of convexity notions. Specifically, we derive bounds on the expected instantaneous tracking error, and we provide algorithm parameter values that minimise the algorithm's performance. Our results illustrate how the manifold geometry in terms of the sectional curvature affects these bounds. Additionally, we provide dynamic regret bounds for this online optimisation setting. To the best of our knowledge, these are the first regret bounds even for the Euclidean version of the problem. Lastly, via numerical simulations, we demonstrate the applicability of our algorithm on an online Karcher mean problem.

Estimation of unmeasured variables is a crucial objective in a broad range of applications. However, the estimation process turns into a challenging problem when the underlying model is nonlinear and even more so when additionally it exhibits multiple time scales. The existing results on estimation for systems with two time scales apply to a limited class of nonlinear plants and observers. We focus on analyzing nonlinear observers designed for the slow state variables of nonlinear singularly perturbed systems. Moreover, we consider the presence of bounded measurement noise in the system. We generalize current results by considering broader classes of plants and estimators to cover reduced‐order, full‐order, and higher‐order observers. First, we show that the singularly perturbed system has bounded solutions under an appropriate set of assumptions on the corresponding boundary layer and reduced systems. We then exploit this property to prove that, under reasonable assumptions, the error dynamics of the observer designed for the reduced system are semiglobally input‐to‐state practically stable when the observer is implemented on the original plant. We also conclude ℒ2 stability results when the measurement noise belongs to ℒ2∩ℒ∞ . In the absence of measurement noise, we state results on semiglobal practical asymptotical stability for the error dynamics. We illustrate the generality of our main results through three classes of systems with corresponding observers and one numerical example.

We propose a framework for designing observers possessing global convergence properties and desired asymptotic behaviors for the state estimation of nonlinear systems. The proposed scheme consists in combining two given continuous-time observers: One, denoted as global, ensures (approximate) convergence of the estimation error for any initial condition ranging in some prescribed set, while the other, denoted as local, guarantees a desired local behavior. We make assumptions on the properties of these two observers, and not on their structures, and then explain how to unite them as a single scheme using hybrid techniques. Two case studies are provided to demonstrate the applicability of the framework. Finally, a numerical example is presented.

We study the design of state observers for nonlinear networked control systems (NCSs) affected by disturbances and measurement noise, via an emulation-like approach. That is, given an observer designed with a specific stability property in the absence of communication constraints, we implement it over a network, and we provide sufficient conditions on the latter to preserve the stability property of the observer. In particular, we provide a bound on the maximum allowable transmission interval (MATI) that guarantees an input-to-state stability (ISS) property for the corresponding estimation error system. The stability analysis is trajectory-based, utilizes small-gain arguments, and exploits a persistently exciting property of the scheduling protocols. This property is key in our analysis and allows us to obtain significantly larger MATI bounds in comparison to the ones found in the literature. Our results hold for a general class of NCSs; however, we show that these results are also applicable to NCSs implemented over a specific physical network called WirelessHART (WH). The latter is mainly characterized by its multihop structure, slotted communication cycles, and the possibility to simultaneously transmit over different frequencies. We show that our results can be further improved by taking into account the intrinsic structure of the WH–NCS model. That is, we explicitly exploit the model structure in our analysis to obtain an even tighter MATI bound that guarantees the same ISS property for the estimation error system. Finally, to illustrate our results, we present analysis and numerical simulations for a class of Lipschitz nonlinear systems and high-gain observers.