Modern machine learning models have started to consume incredible amounts of energy, thus incurring large carbon footprints (Strubell et al., 2019). To address this issue, we have created an energy estimation pipeline1, which allows practitioners to estimate the energy needs of their models in advance, without actually running or training them. We accomplished this, by collecting high-quality energy data and building a first baseline model, capable of predicting the energy consumption of DL models by accumulating their estimated layer-wise energies.
翻译:准确率不是唯一重要的指标:估算深度学习模型的能耗
翻译后的摘要:
现代机器学习模型开始消耗大量能源,从而产生巨大的碳足迹(Strubell等人,2019)。为解决这个问题,我们创建了一个能源估算管道1,可以让从业人员在运行或训练模型之前预先估算其能源需求。我们通过收集高质量的能源数据,并构建了一个基准模型,能够通过累计估计的层次能量来预测DL模型的能耗。