Your email was sent successfully. Check your inbox.

An error occurred while sending the email. Please try again.

Proceed reservation?

Export
Filter
  • Markov decision processes  (6)
  • duality  (5)
  • 1
    Electronic Resource
    Electronic Resource
    Springer
    ISSN: 1432-5217
    Keywords: Generalized convexity ; duality ; root term ; optimal solution
    Source: Springer Online Journal Archives 1860-2000
    Topics: Mathematics , Economics
    Notes: Abstract We extend the duality theorems for a class of nondifferentiable problems with Mond-Weir type duals.
    Type of Medium: Electronic Resource
    Signatur Availability
    BibTip Others were also interested in ...
  • 2
    ISSN: 1432-5217
    Keywords: Hybrid stochastic systems ; Markov decision processes ; nonlinear systems
    Source: Springer Online Journal Archives 1860-2000
    Topics: Mathematics , Economics
    Notes: Abstract We consider the problem of control for continuous time stochastic hybrid systems in finite time horizon. The systems considered are nonlinear: the state evolution is a nonlinear function of both the control and the state. The control parameters change at discrete times according to an underlying controlled Markov chain which has finite state and action spaces. The objective is to design a controller which would minimize an expected nonlinear cost of the state trajectory. We show using an averaging procedure, that the above minimization problem can be approximated by the solution of some deterministic optimal control problem. This paper generalizes our previous results obtained for systems whose state evolution is linear in the control.
    Type of Medium: Electronic Resource
    Signatur Availability
    BibTip Others were also interested in ...
  • 3
    Electronic Resource
    Electronic Resource
    Springer
    ISSN: 1432-5217
    Keywords: Quasi-inverse ; epi-inverse ; hypo-inverse ; nondecreasing functions ; quasiconvex functions ; convex functions ; duality ; rearrangement ; modulus of continuity
    Source: Springer Online Journal Archives 1860-2000
    Topics: Mathematics , Economics
    Description / Table of Contents: Zusammenfassung In dieser Arbeit wird systematisch die Umkehrung monoton nichtfallender Funktionenf: ℝ → ℝ ∪ {−∞, +∞} studiert. Die Ergebnisse bilden die Grundlage für eine neue Dualitätstheorie quasikonvexer Probleme [6]. Da jedoch die Fragestellung bei einer ganzen Anzahl weiterer Situationen auftritt, verdient sie eine gesonderte Behandlung. Anwendungen in der Topologie, Wahrscheinlichkeitstheorie, monotonen Umordnungen und in der konvexen Analysis werden aufgezeigt und skizziert.
    Notes: Abstract This work is devoted to a systematic study of the inversion of nondecreasing one variable extended real-valued functions. Its results are preparatory for a new duality theory for quasiconvex problem [6]. However the question arises in a variety of situations and as such deserves a separate treatment. Applications to topology, probability theory, monotone rearrangements, convex analysis are either pointed out or sketched.
    Type of Medium: Electronic Resource
    Signatur Availability
    BibTip Others were also interested in ...
  • 4
    Electronic Resource
    Electronic Resource
    Springer
    ISSN: 1432-5217
    Keywords: vectorial control-approximation problem ; vectorial location problem ; duality ; efficiency
    Source: Springer Online Journal Archives 1860-2000
    Topics: Mathematics , Economics
    Description / Table of Contents: Zusammenfassung In der Arbeit werden für eine Klasse von vektoriellen Steuer-Approximationsproblemen in reellen reflexiven Banachräumen vektorielle Dualprobleme konstruiert und Dualitätseigenschaften hergeleitet. Als Spezialfall ergeben sich entsprechende Aussagen für vektorielle Standortprobleme.
    Notes: Abstract The author formulates vectorial dual problems for a certain class of vectorial control-approximation problems in real reflexive Banach spaces. A number of propositions concerning duality are derived. Corresponding propositions are mentioned for the special case of the vectorial location problems.
    Type of Medium: Electronic Resource
    Signatur Availability
    BibTip Others were also interested in ...
  • 5
    ISSN: 1432-5217
    Keywords: Markov decision processes ; countable state space ; Linear programming ; duality
    Source: Springer Online Journal Archives 1860-2000
    Topics: Mathematics , Economics
    Notes: Abstract We present an Linear Programming formulation of MDPs with countable state and action spaces and no unichain assumption. This is an extension of the Hordijk and Kallenberg (1979) formulation in finite state and action spaces. We provide sufficient conditions for both existence of optimal solutions to the primal LP program and absence of duality gap. Then, existence of a (possibly randomized) average optimal policy is also guaranteed. Existence of a stationary average optimal deterministic policy is also investigated.
    Type of Medium: Electronic Resource
    Signatur Availability
    BibTip Others were also interested in ...
  • 6
    ISSN: 1432-5217
    Keywords: Markov decision processes ; partially observable ; linear programming
    Source: Springer Online Journal Archives 1860-2000
    Topics: Mathematics , Economics
    Notes: Abstract In this paper we use an approach which uses a superharmonic property of a sequence of functions generated by an algorithm to show that these functions converge in a non-increasing manner to the optimal value function for our problem, and bounds are given for the loss of optimality if the computational process is terminated at any iteration. The basic procedure is to add an additional linear term at each iteration, selected by solving a particular optimisation problem, for which primal and dual linear programming formulations are given.
    Type of Medium: Electronic Resource
    Signatur Availability
    BibTip Others were also interested in ...
  • 7
    ISSN: 1432-5217
    Keywords: Markov decision processes ; algorithms ; homotopy
    Source: Springer Online Journal Archives 1860-2000
    Topics: Mathematics , Economics
    Notes: Abstract In this paper we consider a homotopy deformation approach to solving Markov decision process problems by the continuous deformation of a simpler Markov decision process problem until it is identical with the original problem. Algorithms and performance bounds are given.
    Type of Medium: Electronic Resource
    Signatur Availability
    BibTip Others were also interested in ...
  • 8
    Electronic Resource
    Electronic Resource
    Springer
    ISSN: 1432-5217
    Keywords: Optimization theory ; mathematical programming ; duality ; half spaces ; minimum norm duality ; separating hyperplanes
    Source: Springer Online Journal Archives 1860-2000
    Topics: Mathematics , Economics
    Notes: Abstract This note shows that half spaces play a very special role in the development of duality. In addition to the minimum norm duality, the duality in linear programming, and Wolfe's and Johri's formulations in nonlinear programming can all be derived via half spaces by following an identical five step procedure.
    Type of Medium: Electronic Resource
    Signatur Availability
    BibTip Others were also interested in ...
  • 9
    ISSN: 1432-5217
    Keywords: Dynamic programming ; Markov decision processes ; queueing control models ; queues with vacations
    Source: Springer Online Journal Archives 1860-2000
    Topics: Mathematics , Economics
    Notes: Abstract Consider anM/M/1 queueing system with server vacations where the server is turned off as soon as the queue gets empty. We assume that the vacation durations form a sequence of i.i.d. random variables with exponential distribution. At the end of a vacation period, the server may either be turned on if the queue is non empty or take another vacation. The following costs are incurred: a holding cost ofh per unit of time and per customer in the system and a fixed cost of γ each time the server is turned on. We show that there exists a threshold policy that minimizes the long-run average cost criterion. The approach we use was first proposed in Blanc et al. (1990) and enables us to determine explicitly the optimal threshold and the optimal long-run average cost in terms of the model parameters.
    Type of Medium: Electronic Resource
    Signatur Availability
    BibTip Others were also interested in ...
  • 10
    ISSN: 1432-5217
    Keywords: Optimal control ; Markov decision processes ; light traffic ; discounted cost ; average cost
    Source: Springer Online Journal Archives 1860-2000
    Topics: Mathematics , Economics
    Notes: Abstract We consider Markov Decision Processes under light traffic conditions. We develop an algorithm to obtain asymptotically optimal policies for both the total discounted and the average cost criterion. This gives a general framework for several light traffic results in the literature. We illustrate the method by deriving the asymptotically optimal control of a simple ATM network.
    Type of Medium: Electronic Resource
    Signatur Availability
    BibTip Others were also interested in ...
Close ⊗
This website uses cookies and the analysis tool Matomo. More information can be found here...