Skip to content
Snippets Groups Projects

fix: remove duplicate hydrateAndFilter

Merged Yoan VALLET requested to merge fix/optimization into dev
3 files
+ 8
8
Compare changes
  • Side-by-side
  • Inline
Files
3
+ 6
6
@@ -19,15 +19,19 @@ moment.tz.setDefault('Europe/Paris') // set the timezone
/*** Connector Constants ***/
const manualExecution =
process.env.COZY_JOB_MANUAL_EXECUTION === 'true' ? true : false
// Period for daily data
const startDailyDate = manualExecution
? moment().subtract(12, 'month')
: moment().subtract(32, 'month')
const startDailyDateString = startDailyDate.format('YYYY-MM-DD')
// Period for half and hour data
const startLoadDate = moment().subtract(7, 'day')
const startLoadDateString = startLoadDate.format('YYYY-MM-DD')
// Period to define if the history is loaded
const checkHistoryDate = moment().subtract(8, 'day')
const endDate = moment()
const endDateString = endDate.format('YYYY-MM-DD')
// Endpoints config
const baseUrl = 'https://gw.prd.api.enedis.fr'
const dailyDataURL = `${baseUrl}/v4/metering_data/daily_consumption`
const loadCurveURL = `${baseUrl}/v4/metering_data/consumption_load_curve`
@@ -359,13 +363,9 @@ async function processData(data, doctype, filterKeys) {
const parsedData = JSON.parse(data)
const intervalData = parsedData.meter_reading.interval_reading
const formatedData = await formateData(intervalData, doctype)
// Remove data for existing days into the DB
const filteredData = await hydrateAndFilter(formatedData, doctype, {
keys: filterKeys,
})
// Store new day data
await storeData(filteredData, doctype, filterKeys)
return filteredData
const storedData = await storeData(formatedData, doctype, filterKeys)
return storedData
}
/**
Loading