To compare model performance across different datasets by scaling the error metrics, you can normalize both RMSE and MAE:
Normalized RMSE:
using the mean of data set: (i.e., Coefficient of Variation of RMSE)
using the difference between maximum and minimum in data set: ,
using the standard deviation of data set: , or
using the interquartile range of data set; , i.e. the difference between 25th and 75th percentile, of observations.
Normalized MAE:
- aka. Coefficient of Variation of MAE; Coefficient of Variation (CV) = the ratio of the standard deviation to the mean ,
using the mean of data set: