tToday, as a consequence of the growing installation of efficient technologies, e.g. micro-combined heatand power (micro-CHP), the integration of traditionally separated electricity and natural gas networkshas been attracting attentions from researchers in both academia and industry. To model the interactionamong electricity and natural gas networks in distribution systems, this paper models a residential cus-tomer in a multi-energy system (MES). In this paper, we propose a fully automated energy managementsystem (EMS) based on a reinforcement learning (RL) algorithm to motivate residential customers for par-ticipating in demand side management (DSM) programs and reducing the peak load in both electricityand natural gas networks. This proposed EMS estimates the residential customers’ satisfaction function,energy prices, and efficiencies of appliances based on the residential customers’ historical actions. Sim-ulations are performed for the sample model and results depict how much of each energy, i.e. electricityand natural gas, the residential customer should consume and how much of natural gas should be con-verted in order to meet electricity and heating loads. It is also shown that the proposed RL algorithmreduces residential customer energy bill and electrical peak load up to 20% and 24%, respectively