
Optimal unbounded control problems with affine control dependence may fail to
have minimizers in the class of absolutely continuous state trajectories. For
this reason, extended impulsive versions which cannot be of
measuretheoretical type have been investigated, in which the domain is
enlarged to include discontinuous state trajectories of bounded variation, and
for which existence of minimizers is guaranteed. It is of interest to know
whether the passage from the original optimal control problem to its extension
introduces an infimum gap. This paper provides sufficient conditions for the
absence of an infimum gap based on normality of extremals. In certain cases,
the normality conditions reduce to simple verifiable criteria, which improve on
earlier, directlyderived sufficient conditions for no infimum gap.

If $f_1,f_2$ are smooth vector fields on an open subset of an Euclidean space
and $[f_1,f_2]$ is their Lie bracket, the asymptotic formula
$$\Psi_{[f_1,f_2]}(t_1,t_2)(x)  x =t_1t_2 [f_1,f_2](x) +o(t_1t_2),$$ where we
have set $ \Psi_{[f_1,f_2]}(t_1,t_2)(x) :=
\exp(t_2f_2)\circ\exp(t_1f_1)\circ\exp(t_2f_2)\circ\exp(t_1f_1)(x)$, is valid
for all $t_1,t_2$ small enough.
In fact, the integral, exact formula \begin{equation}\label{abstractform}
\Psi_{[f_1,f_2]}(t_1,t_2)(x)  x =
\int_0^{t_1}\int_0^{t_2}[f_1,f_2]^{(s_2,s_1)} (\Psi(t_1,s_2)(x))ds_1\,ds_2 ,
\end{equation} where $ [f_1,f_2]^{(s_2,s_1)}(y) := D\Big(\exp(s_1f_1)\circ
\exp(s_2f_2{{)}}\Big)^{1}\cdot [f_1,f_2](\exp(s_1f_1)\circ \exp(s_2f_2){(y)}),
$ with ${{y = \Psi(t_1,s_2)(x)}}$ has also been proven. Of course the integral
formula can be regarded as an improvement of the asymptotic formula. In this
paper we show that an integral representation holds true for any iterated
bracket made from elements of a family of vector fields ${f_1,\dots,f_{{k}}}$.
In perspective, these integral representations might lie at the basis for
extensions of asymptotic formulas involving nonsmooth vector fields.

For a given closed target we embed the dissipative relation that defines a
control Lyapunov function in a more general differential inequality involving
Hamiltonians built from iterated Lie brackets. The solutions of the resulting
extended relation, here called degreek control Lyapunov functions (k>=1), turn
out to be still sufficient for the system to be globally asymptotically
controllable to the target. Furthermore, we work out some examples where no
standard (i.e., degree1) smooth control Lyapunov functions exist while a
smooth degreek control Lyapunov function does exist, for some k>1. The
extension is performed under very weak regularity assumptions on the system, to
the point that, for instance, (set valued) Lie brackets of locally Lipschitz
vector fields are considered as well.

Let a control system and a target be given on an open subset of an Euclidean
space. The existence of a Control Lyapunov Function  namely a positive
definite, semiconcave, solution of the HamiltonJacobi inequality corresponding
to the control vector field  guarantees Global Asymptotic Controllability
(GAC). In this case, however, minimization is not an issue. Instead, if a
Lagrangean with nonnegative values is considered as well, an optimal control
problem can be defined in relation to the corresponding integral functional.
In the first part of the present paper we show that the existence of a
Minimum Restraint Function  a solution of a strict HamiltonJacobi inequality
involving the Lagrangian and a nonnegative "savings multiplier"  provides
not only global asymptotic controllability but also savings, namely a
statedependent upper bound for the infima. This extends a former result, where
the control set was assumed to be compact. Here we allow unbounded controls and
replace inputs' values' compactness with a quite mild hypothesis concerning the
dependence of the data on inputs: such condition is met, for instance, by
control vector fields that are compositions of Lipschitz maps with polynomials
and exponentials of the control variable.
In the second part of the paper we focus on the case when the dynamics is a
polynomial in the control variable. Through some analysis of convexity
properties of vectorvalued polynomials' ranges, we prove some simplified
versions of the main result, in terms of either affine representability or
reduction to weak subsystems for the original dynamics.

For a control Cauchy problem $$\dot x= {f}(t,x,u,v) +\sum_{\alpha=1}^m
g_\alpha(x) \dot u_\alpha,\quad x(a)=\bar x, $$ on an interval $[a,b]$, we
propose a notion of limit solution $x,$ verifying the following properties: i)
$x$ is defined for $\mathcal{L}^1$ (impulsive) inputs $u$ and for standard,
bounded measurable, controls $v$; ii) in the commutative case (i.e. when
$[g_{\alpha},g_{\beta}]\equiv 0,$ for all $\alpha,\beta=1,...,m$), $x$
coincides with the solution one can obtain via the change of coordinates that
makes the $g_\alpha$ simultaneously constant; iii) $x$ subsumes former concepts
of solution valid for the generic, noncommutative case.
In particular, when $u$ has bounded variation, we investigate the relation
between limit solutions and (singlevalued) graph completion solutions.
Furthermore, we prove consistency with the classical Carath\'eodory solution
when $u$ and $x$ are absolutely continuous.
Even though some specific problems are better addressed by means of special
representations of the solutions, we believe that various theoretical issues
call for a unified notion of trajectory. For instance, this is the case of
optimal control problems, possibly with state and endpoint constraints, for
which no extra assumptions (like e.g. coercivity, bounded variation,
commutativity) are made in advance.

We investigate an everywhere defined notion of solution for control systems
whose dynamics depend nonlinearly on the control $u$ and state $x,$ and are
affine in the time derivative $\dot u.$ For this reason, the input $u,$ which
is allowed to be Lebesgue integrable, is called impulsive, while a second,
bounded measurable control $v$ is denominated ordinary. The proposed notion of
solution is derived from a topological (nonmetric) characterization of a
former concept of solution which was given in the case when the drift is
$v$independent. Existence, uniqueness and representation of the solution are
studied, and a close analysis of effects of (possibly infinitely many)
discontinuities on a null set is performed as well.

We consider control systems governed by nonlinear O.D.E.'s that are affine in
the timederivative du/dt of the control u. The latter is allowed to be an
integrable, possibly of unbounded variation function, which gives the system an
impulsive character. As is wellknown, the corresponding Cauchy problem cannot
be interpreted in terms of Schwartz distributions, even in the commutative
case. A robust notion of solution already proposed in the literature is here
adopted and slightly generalized to the case where an ordinary, bounded,
control is present in the dynamics as well. For a problem in the Mayer form we
then investigate the question whether this notion of solution provides a
"proper extension" of the standard problem with absolutely continuous controls
u. Furthermore, we show that this impulsive problem is a variational limit of
problems corresponding to controls u with bounded variation.

We consider a control problem where the state must reach asymptotically a
target while paying an integral payoff with a nonnegative Lagrangian. The
dynamics is just continuous, and no assumptions are made on the zero level set
of the Lagrangian. Through an inequality involving a positive number $\bar p_0$
and a Minimum Restraint Function $U=U(x)$ a special type of Control Lyapunov
Function we provide a condition implying that (i) the control system is
asymptotically controllable, and (ii) the value function is bounded above by
$U/\bar p_0$.

In this article we study control problems with systems that are governed by
ordinary differential equations whose vector fields depend linearly in the time
derivatives of some components of the control. The remaining components are
considered as classical controls. This kind of system is called `impulsive
system'. We assume that the vector fields multiplying the derivatives of each
component of the control are commutative. We derive new necessary conditions in
terms of the adjoint state and the Lie brackets of the data functions.

The paper is concerned with mechanical systems which are controlled by
implementing a number of timedependent, frictionless holonomic constraints.
The main novelty is due to the presence of additional nonholonomic
constraints. We develop a general framework to analyze these problems, deriving
the equations of motion and studying the continuity properties of the
"controltotrajectory" maps. Various geometric characterizations are provided,
in order that the equations be affine w.r.t. the time derivative of the
control. In this case the system is fit for jumps, and the evolution is well
defined also in connection with discontinuous control functions. The classical
Roller Racer provides an example where the nonaffine dependence of the
equations on the derivative of the control is due only to the nonholonomic
constraint. This is a case where the presence of quadratic terms in the
equations can be used for controllability purposes.