In recent times, deep learning-based black box forecasting models have gained notable recognition for their ability to predict energy demand with considerably higher accuracy. This study presents a novel hybrid adaptive deep learning model (HyADLeM) to forecast residential heating loads, comprising LSTM and/or GRU networks, based on the selection of these neural networks by multi-objective optimisation algorithms (MOOAs) such as non- dominated sorting genetic algorithm-II (NSGA-II), NSGA-III, multi-objective particle swarm optimisation (MOPSO), and multi-objective ant colony optimisation (MOACO). The study also aims to compare the hyperparameter optimisation performance of the MOOAs, along with forecasting performance of the proposed model employed with MOOAs. Hyperparameters, including the number of hidden layers, type of hidden layers, number of neurons in each hidden layer, batch size, window size, and learning rate, were optimised by the MOOAs. The optimisation objectives were to minimise the coefficient of variation of root mean square error (CV(RMSE)), normalised mean bias error (NMBE) and computation time. The MOOAs were compared based on their Pareto-solution diversity, CV(RMSE), NMBE and computation time. The results demonstrate that the NSGA-III-HyADLeM was 32% faster than the worst-performing model during training, despite having a more complex model architecture. Also, it outperformed all the other MOOA-based HyADLeM in terms of CV(RMSE) and NMBE. Additionally, the model showed promising performance in forecasting heating related electrical loads (EL) across datasets with varying temporal patterns, supporting its generalisability.