References of "Ernst, Damien"
     in
Bookmark and Share    
Full Text
See detailNear Optimal Closed-Loop Control. Application to Electric Power Systems
Ernst, Damien ULg

Doctoral thesis (2003)

Detailed reference viewed: 30 (10 ULg)
Full Text
Peer Reviewed
See detailIteratively extending time horizon reinforcement learning
Ernst, Damien ULg; Geurts, Pierre ULg; Wehenkel, Louis ULg

in Machine Learning: ECML 2003, 14th European Conference on Machine Learning (2003)

Reinforcement learning aims to determine an (infinite time horizon) optimal control policy from interaction with a system. It can be solved by approximating the so-called Q-function from a sample of four ... [more ▼]

Reinforcement learning aims to determine an (infinite time horizon) optimal control policy from interaction with a system. It can be solved by approximating the so-called Q-function from a sample of four-tuples (x(t), u(t), r(t), x(t+1)) where x(t) denotes the system state at time t, ut the control action taken, rt the instantaneous reward obtained and x(t+1) the successor state of the system, and by determining the optimal control from the Q-function. Classical reinforcement learning algorithms use an ad hoc version of stochastic approximation which iterates over the Q-function approximations on a four-tuple by four-tuple basis. In this paper, we reformulate this problem as a sequence of batch mode supervised learning problems which in the limit converges to (an approximation of) the Q-function. Each step of this algorithm uses the full sample of four-tuples gathered from interaction with the system and extends by one step the horizon of the optimality criterion. An advantage of this approach is to allow the use of standard batch mode supervised learning algorithms, instead of the incremental versions used up to now. In addition to a theoretical justification the paper provides empirical tests in the context of the "Car on the Hill" control problem based on the use of ensembles of regression trees. The resulting algorithm is in principle able to handle efficiently large scale reinforcement learning problems. [less ▲]

Detailed reference viewed: 40 (6 ULg)
Full Text
Peer Reviewed
See detailA reinforcement learning based discrete supplementary control for power system transient stability enhancement
Glavic, Mevludin; Ernst, Damien ULg; Wehenkel, Louis ULg

in Proceedings of the 12th Intelligent Systems Application to Power Systems Conference (ISAP 2003) (2003)

This paper proposes an application of a Reinforcement Learning (RL) method to the control of a dynamic brake aimed to enhance power system transient stability. The control law of the resistive brake is in ... [more ▼]

This paper proposes an application of a Reinforcement Learning (RL) method to the control of a dynamic brake aimed to enhance power system transient stability. The control law of the resistive brake is in the form of switching strategies. In particular, the paper focuses on the application of a model based RL method, known as prioritized sweeping, a method proven to be suitable in applications in which computation is considered to be cheap. The curse of dimensionality problem is resolved by the system state dimensionality reduction based on the One Machine Infinite Bus (OMIB) transformation. Results obtained by using a synthetic four-machine power system are given to illustrate the performances of the proposed methodology. [less ▲]

Detailed reference viewed: 24 (1 ULg)
Full Text
Peer Reviewed
See detailTransient stability emergency control combining open-loop and closed-loop technique
Ruiz-Vega, Daniel; Glavic, Mevludin; Ernst, Damien ULg

in Proceedings of the IEEE Power Engineering Society General Meeting, 2003 (2003)

An on-line transient stability emergency control approach is proposed, which couples an open-loop and a closed-loop emergency control technique. The open-loop technique uses on-line transient stability ... [more ▼]

An on-line transient stability emergency control approach is proposed, which couples an open-loop and a closed-loop emergency control technique. The open-loop technique uses on-line transient stability assessment in order to adapt the settings of automatic system protection schemes to the current operating conditions. On the other hand, the closed-loop technique uses measurements in order to design and trigger countermeasures, after the contingency has actually happened, then to continue monitoring in a closed-loop fashion. The approach aims at combining advantages of event-based and measurement-based system protection schemes, namely, speed of action and robustness with respect to uncertainties in system modeling. It can also comply with economic criteria. [less ▲]

Detailed reference viewed: 138 (2 ULg)
Full Text
Peer Reviewed
See detailClosure of "a unified approach to transient stability contingency filtering, ranking, and assessment"
Ernst, Damien ULg; Ruiz-Vega, Daniel; Pavella, Mania ULg et al

in IEEE Transactions on Power Systems (2002), 17(2), 528-529

Detailed reference viewed: 30 (2 ULg)
Full Text
Peer Reviewed
See detailFACTS devices controlled by means of reinforcement learning algorithms
Ernst, Damien ULg; Wehenkel, Louis ULg

in Proceedings of the 14th Power Systems Computation Conference (PSCC 2002) (2002)

Reinforcement learning consists of a collection of methods for approximating solutions to deterministic and stochastic optimal control problems of unknown dynamics. These methods learn by experience how ... [more ▼]

Reinforcement learning consists of a collection of methods for approximating solutions to deterministic and stochastic optimal control problems of unknown dynamics. These methods learn by experience how to adjust a closed-loop control rule which is a mapping from the system states to control actions. This paper proposes an application of reinforcement learning methods to the control of a FACTS device aimed to damp power system oscillations. A detailed case study is carried out on a synthetic four-machine power system. [less ▲]

Detailed reference viewed: 22 (1 ULg)
Full Text
Peer Reviewed
See detailA unified approach to transient stability contingency filtering, ranking and assessment
Ernst, Damien ULg; Ruiz-Vega, Daniel; Pavella, Mania ULg et al

in IEEE Transactions on Power Systems (2001), 16(3), 435-443

This paper proposes a unified approach to contingency filtering, ranking and assessment in power system transient stability studies. The approach consists of two-block techniques in which the first block ... [more ▼]

This paper proposes a unified approach to contingency filtering, ranking and assessment in power system transient stability studies. The approach consists of two-block techniques in which the first block selects from a list of contingencies the a priori “interesting” ones, that the second block ranks and assesses. This Filtering, Ranking and Assessment (FILTRA) approach relies on SIME (for SIngle Machine Equivalent). SIME is a hybrid direct-time-domain stability method which combines accuracy and flexibility skills of time-domain methods with sound additional possibilities of direct methods. The FILTRA approach is fully general: it may adapt itself to the specifics of any power system (modeling, protection characteristics, etc.), any contingency scenario and mode of (in)stability (first- or multi-swing, local or inter-area mode) and any application context (planning, operation planning and real-time operation). The approach is illustrated on two EHV power systems, having different structures, control and protective devices. The adequacy of its filtering and ranking capabilities is illustrated in terms of performance criteria such as reliability (ability to consistently capture all dangerous contingencies), effectiveness (ability to avoid false alarms) and computational efficiency (ability to comply with real-time requirements). Further, the assessment task is shown to provide the operator with sound information and effective means of control. [less ▲]

Detailed reference viewed: 47 (3 ULg)
Full Text
Peer Reviewed
See detailA control strategy for controllable series capacitor in electric power systems
Ghandhari, Mehrdad; Andersson, Goran; Pavella, Mania ULg et al

in Automatica (2001), 37

It has been veri"ed that a controllable series capacitor with a suitable control scheme can improve transient stability and help to damp electromechanical oscillations. A question of great importance is ... [more ▼]

It has been veri"ed that a controllable series capacitor with a suitable control scheme can improve transient stability and help to damp electromechanical oscillations. A question of great importance is the selection of the input signals and a control strategy for this device in order to damp power oscillations in an e!ective and robust manner. Based on Lyapunov theory a control strategy for damping of electromechanical power oscillations in a multi-machine power system is derived. Lyapunov theory deals with dynamical systems without inputs. For this reason, it has traditionally been applied only to closed-loop control systems, that is, systems for which the input has been eliminated through the substitution of a predetermined feedback control. However, in this paper, we use Lyapunov function candidates in feedback design itself by making the Lyapunov derivative negative when choosing the control. This control strategy is called control Lyapunov function for systems with control inputs. Also, two input signals for this control strategy are used. The "rst one is based on local information and the second one on remote information derived by the single machine equivalent method. [less ▲]

Detailed reference viewed: 37 (1 ULg)
Full Text
Peer Reviewed
See detailAn approach to modal analysis of power system angle stability
Roth, Anna; Ruiz-Vega, Daniel; Ernst, Damien ULg et al

in Proceedings of IEEE Powertech 2001 (2001)

An approach to modal analysis and modal identification is proposed, capable of complementing the panoply of existing methods. It is based on a hybrid time-domain – direct transient stability method called ... [more ▼]

An approach to modal analysis and modal identification is proposed, capable of complementing the panoply of existing methods. It is based on a hybrid time-domain – direct transient stability method called SIME (for SIngle Machine Equivalent). In short, SIME uses a conventional transient stability program to transform the time varying parameters of the system into those of a one-machine infinite bus (OMIB) equivalent system. The representations of this OMIB allow substantial reduction of the original problem’s dimensionality. Many important advantages may result. For example, the multimachine system unstable equilibrium point (UEP) can readily be derived from the OMIB UEP, which is calculated analytically and unambiguously in a two-dimensional space. Further, the interplay between multimachine and OMIB characteristics and their complementary properties provides a better understanding and handling of damping, inter-area oscillations and their control. More generally, modal analysis and modal identification tasks get closer to each other and easier to handle. The paper essentially focuses on the approach as such rather than on potential applications. Simulations carried out on a 3-machine system illustrate main features. [less ▲]

Detailed reference viewed: 66 (1 ULg)
Full Text
Peer Reviewed
See detailReinforcement learning applied to power system oscillations damping
Ernst, Damien ULg

in Proceedings of the 40th Conference on Decision and Control (CDC 2001) (2001)

Detailed reference viewed: 4 (0 ULg)
Full Text
See detailTransient Stability of Power Systems: A Unified Approach to Assessment and Control
Pavella, Mania ULg; Ernst, Damien ULg; Ruiz-Vega, Daniel

Book published by Kluwer Academic Publishers (2000)

Detailed reference viewed: 93 (6 ULg)
Full Text
Peer Reviewed
See detailClosed-loop transient stability emergency control
Ernst, Damien ULg; Pavella, Mania ULg

in Proceedings of the IEEE Power Engineering Society Winter Meeting 2000 (2000)

The question of transient stability control is revisited, various types of controls are identified, and a general approach to closed-loop emergency control is proposed. The focus is on feasibility aspects ... [more ▼]

The question of transient stability control is revisited, various types of controls are identified, and a general approach to closed-loop emergency control is proposed. The focus is on feasibility aspects, general salient features and illustration of stabilization capabilities of an emergency control scheme relying on generation shedding. [less ▲]

Detailed reference viewed: 33 (6 ULg)
Full Text
Peer Reviewed
See detailOn-line transient stability constrained ATC calculations
Avilas-Rosales, R.; Ruiz-Vega, Daniel; Ernst, Damien ULg et al

in Proceedings of the IEEE Power Engineering Society Summer Meeting 2000 - Volume 2 (2000)

Transient Stability Assessment, preventive control measures and dynamic A X calculations are addressed for the new deregulated EMS system. The combination of time domain analysis, SIME and Optimal Power ... [more ▼]

Transient Stability Assessment, preventive control measures and dynamic A X calculations are addressed for the new deregulated EMS system. The combination of time domain analysis, SIME and Optimal Power Flow provide a reliable solution for future transaction requirements and the current operating point. [less ▲]

Detailed reference viewed: 34 (0 ULg)
Full Text
Peer Reviewed
See detailA contingency filtering, ranking and assessment technique for on-line transient stability studies
Ruiz-Vega, Daniel; Ernst, Damien ULg; Machado Ferreira, C. et al

in Proceedings of International Conference on Electric Utility Deregulation and Restructing and Power Technologies 2000 (2000)

Detailed reference viewed: 121 (0 ULg)
Full Text
Peer Reviewed
See detailPreventive countermeasures for transient stability-constrained power systems
Ruiz-Vega, Daniel; Ernst, Damien ULg; Pavella, Mania ULg

in Proceedings of the VII Symposium of Specialists in Electric Operational and Expansion Planning (SEPOPE 2000) (2000)

A general transient stability control technique is applied to the design of preventive countermeasures consisting of rescheduling generators’ active power. The technique relies on SIME, a hybrid ... [more ▼]

A general transient stability control technique is applied to the design of preventive countermeasures consisting of rescheduling generators’ active power. The technique relies on SIME, a hybrid direct–time-domain method; and, like SIME, it preserves the accuracy of time-domain methods and their ability to handle any power system modeling, stability scenario and mode of instability. Its application to generation rescheduling may provide various patterns, able to comply with various operational specifics and strategies, as, for example, congestion management or available transfer capability calculations. The paper suggest how the technique may be shaped to choose automatically rescheduling patterns. A sample of such patterns are illustrated via simulations performed on an EPRI test system. [less ▲]

Detailed reference viewed: 150 (5 ULg)
Full Text
Peer Reviewed
See detailApplication of reinforcement learning to electrical power system closed-loop emergency control
Druet, Christophe; Ernst, Damien ULg; Wehenkel, Louis ULg

in Principles of Data Mining and Knowledge Discovery, 4th European Conference, PKDD 2000 (2000)

This paper investigates the use of reinforcement learning in electric power system emergency control. The approach consists of using numerical simulations together with on-policy Monte Carlo control to ... [more ▼]

This paper investigates the use of reinforcement learning in electric power system emergency control. The approach consists of using numerical simulations together with on-policy Monte Carlo control to determine a discrete switching control law to trip generators so as to avoid loss of synchronism. The proposed approach is tested on a model of a real large scale power system and results are compared with a quasi-optimal control law designed by a brute force approach for this system. [less ▲]

Detailed reference viewed: 32 (3 ULg)
Full Text
Peer Reviewed
See detailPreventive and emergency transient stability control
Ernst, Damien ULg; Ruiz-Vega, Daniel; Pavella, Mania ULg

in Proceedings of the VII Symposium of Specialists in Electric Operational and Expansion Planning (SEPOPE 2000) (2000)

A unified approach to transient stability closed-loop control is presented. It relies on the general transient stability method called SIME, from which the Preventive and the Emergency SIMEs are derived ... [more ▼]

A unified approach to transient stability closed-loop control is presented. It relies on the general transient stability method called SIME, from which the Preventive and the Emergency SIMEs are derived. The Preventive SIME uses time-domain simulations of plausible contingencies prior to their occurrence, for the online power system monitoring from the control room. The Emergency SIME, on the other hand, uses real-time measurements, acquired on the system power plants after the actual occurrence of a contingency in order to appraise and trigger countermeasures indispensable for the system integrity. Despite fundamental differences in their design and objectives, the two approaches have also common features. This paper highlights main differences and similarities, and illustrates them on a realistic, large power system. The tradeoff between on-line preventive control and real-time emergency control is also assessed in terms of size of the involved countermeasures. [less ▲]

Detailed reference viewed: 51 (10 ULg)
Full Text
Peer Reviewed
See detailA general framework for power system transient stability control
Pavella, Mania ULg; Ernst, Damien ULg; Ruiz-Vega, Daniel

in IEEE Power Engineering Society Letters (1999), 19(10), 45-46

Detailed reference viewed: 37 (6 ULg)
Full Text
Peer Reviewed
See detailTransient stability-constrained optimal power flow
Bettiol, Arlan; Ruiz-Vega, Daniel; Ernst, Damien ULg et al

in Proceedings of the IEEE Power Tech'99 (1999)

This paper proposes a new approach able to maximize the interface flow limits in power systems and to find a new operating state that is secure with respect to both, dynamic (transient stability) and ... [more ▼]

This paper proposes a new approach able to maximize the interface flow limits in power systems and to find a new operating state that is secure with respect to both, dynamic (transient stability) and static security constraints. It combines the Maximum Allowable Transfer (MAT) method, recently developed for the simultaneous control of a set of contingencies, and an Optimal Power Flow (OPF) method for maximizing the interface power flow. The approach and its performances are illustrated by means of simulations carried out on a real world power system. [less ▲]

Detailed reference viewed: 69 (5 ULg)
Full Text
Peer Reviewed
See detailTransient stability-constrained generation rescheduling
Ruiz-Vega, Daniel; Bettiol, Arlan; Ernst, Damien ULg et al

in Proceedings of 1998 IREP Symposium - Bulk Power System Dynamics and Control - IV (1998, August)

Detailed reference viewed: 49 (3 ULg)