CalTRACK
  • CalTRACK Methods
    • CalTRACK Process
    • CalTRACK Compliance
    • Project Updates
    • Technical Working Group >
      • Technical Appendix
      • Issues and Evidence
    • CalTRACK History
    • Stakeholders
  • LFE OpenEEmeter
    • OpenEEmeter Overview
    • Github Code
    • EEweather
    • Documentation
  • FLEXmeter
    • GRIDmeter
    • Energy Differential Privacy
  • Contact

Metrics & Model Selection for Building Qualification

3/12/2018

1 Comment

 
Week Five CalTRACK Update
We look forward to another working group meeting Thursday March 15th.  Here are some updates from the activity last week.  
 Building Qualification Summary:
During the past week, we started discussions to establish an empirical method to determine a building’s suitability for CalTRACK methods. Listed below are two topics related to building qualifications that require testing:
  1. Preferred Metric: The two main metrics being discussed to evaluate a building’s suitability for CalTRACK methods are Coefficient of Variance Root-Mean Standard Error (CVRMSE) and Mean Absolute Percent Error (MAPE). The ideal metric will effectively determine a building’s suitability for CalTRACK methods, while also being convenient for other stakeholders  in pay-for-performance programs.
  2. Model Selection: Due to the tendency of buildings that are unqualified for CalTRACK methods to be intercept-only models, it is proposed that the quality of intercept-only models is evaluated based on the variance of mean usage for daily or billing period data instead of the R-Squared criteria.
Some additional areas that require further analysis before our discussion of building qualifications closes:
  1. How do our metrics and methods align with pay-for-performance programs? Do they reflect performance risk and uncertainty?
  2. What should we do with disqualified buildings? What is the best way to accommodate them in pay-for-performance programs?
The discussion of building qualifications is scheduled to close on March 14th, so remember to add proposals, comments, and test results as soon as possible.
Homework for Participants:
  1. Attend the standing, bi-weekly meeting on Thursday, March 15th at 12:00 PST
  2. Review Github and provide feedback on any relevant issues. This will be the last week for suggesting building qualification test plans.
Picture
1 Comment
Bite Sized Bree link
12/19/2020 06:02:39 am

Great readd thank you

Reply



Leave a Reply.

      Sign Up for Technical Working Group Updates

    Subscribe to Newsletter
    The purpose of this blog is to provide a high-level overview of CalTrack  progress.
    ​
    For a deeper understanding or to provide input on technical aspects of CalTrack, refer to the GitHub issues page (
    https://github.com/CalTRACK-2/caltrack/issues). 
    Recordings
    2019 CalTRACK Kick Off:

    CalTRACK 2.0 
    July 19, 2018
    June 28, 2018
    June 7, 2018
    May 24, 2018
    May 3, 2018
    April 12, 2018
    March 29, 2018
    March 15, 2018
    March 1, 2018
    ​
    February 15, 2018
    February 1, 2018

    Archives

    February 2023
    January 2023
    December 2022
    November 2022
    July 2019
    March 2019
    February 2019
    August 2018
    July 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018

    RSS Feed

Creative Commons License
Creative Commons Attribution-NoDerivatives 4.0 International License.