| Row | Fiscal Year | Strategic Goal Supported | Measurement Area | Measurement Grouping | Measurement Indicator | Baseline | Planned Improvement to the Baseline | Actual Results |
|---|
| 1 | 2005 | S.O. 2.2 - Protect the public against injuries and environmental threats | Mission and Business Results | Border and Transportation Security | Response time to validate that manufacturer data identified in Prior Notice submittals is consistent with FFRM data, as required by the Prior Notice Interim Final Rule | Two independent databases with no linkage and no real-time ability to verify Manufacturer's data. | Link that allows validation and reconciliation of data from PN submissions against Registration, with response to user within 3 seconds (PNSI) and without delaying response > 5 sec for ACS submittals. | System is in Production and functioning within these specifications. Load testing completed with response <2.5 seconds. |
| 2 | 2005 | S.O. 2.2 - Protect the public against injuries and environmental threats | Processes and Activities | Knowledge Management | Number of duplicate firms identified and resolved. | FIRMS data was poor with many duplicates (est. 50,000 duplicates); no process exists to prevent continued introduction of additional duplicates | Use data quality tool to clean up and maintain better data on firms - identify and merge 30,000 duplicates. | Nightly process to maintain clean data has been implemented to identify and clean duplicates, as planned ~40,000 duplicates merged. |
| 3 | 2005 | S.O. 2.2 - Protect the public against injuries and environmental threats | Technology | Internal Data Sharing | Number of years of historical data available for queries, reporting, and trend analysis. | Current system provides access to 1 year of data | Provide access to 4 years of data | Migration of historical data into Production is complete. System is available to users. Up to 11 years of data is available. |
| 4 | 2005 | S.O. 2.2 - Protect the public against injuries and environmental threats | Customer Results | Accuracy of Service or Product Delivered | % of new FFRM records validated. | None, new system (no method currently exists to validate electronically) | FMLS will provide validation of address information, determine existence of firm, and update as needed, for >99% of new FFRM records | Batch process for validation is in Production for FFRM and OASIS. Real time validation is in Production for PNSI. All (100%) FFRM records are validated by FMLS. |
| 5 | 2006 | S.O. 2.2 - Protect the public against injuries and environmental threats | Mission and Business Results | Border and Transportation Security | Number of PN reports available. | Reporting dependent on time-consuming SQL queries and manipulation of data in Excel; no standard reports available. | Expanded range of PN reports allow users to rapidly obtain critical information; 2 initial reports and PN Datamart available. | PN Data Mart and 3 reports are now available using Production system. ~10 additional relevant reports available through Imports menu |
| 6 | 2006 | Effective Management of Human Capital/Information Technology/Resources | Processes and Activities | Productivity | Number of modules/reports with OLAP capabilities enabled | Reporting requires custom development of SQL code | 5 modules/ >50 reports | New system is available for target program areas & reports |
| 7 | 2006 | S.O. 2.2 - Protect the public against injuries and environmental threats | Customer Results | Customer Impact or Burden | Number of canned reports available to allow easy retrieval of data | Data resides in database designed for operations, not queries. All reports require custom coding. | Organize FACTS \ OASIS data into pre summarized, aggregated subject area data marts, with at least 200 reports available. | Initial OASIS data marts are complete. >500 Domestic reports are available. |
| 8 | 2006 | S.O. 2.2 - Protect the public against injuries and environmental threats | Technology | Internal Data Sharing | Interface with new MARCS database. Measure length of time for extraction job. | Data extracted from legacy databases; time will be remeasured just prior to migration. | Migration from new system with no significant impact on system performance | MARCS plans to move to UNIX prior to database redesign; work will proceed once MARCS is ready. |
| 9 | 2007 | S.O. 2.2 - Protect the public against injuries and environmental threats | Mission and Business Results | Population Health Management and Consumer Safety | Number of Data Marts available for user queries. | Data resides in legacy database designed for operations, not queries. | Develop and deploy average of 1 new Data Mart/year, including Firms, Products, Organizations, and Program Assignments, to ensure consistent reporting across ORA enabling broader analysis and trending | Deferred to FY 2008-9 due to changing priorities. Firms and Laboratory Data Marts are in development. Additional data marts will be developed following completion. |
| 10 | 2007 | Effective Management of Human Capital/Information Technology/Resources | Processes and Activities | Security | Number of separate user accounts required for ORA systems | System-specific independent login requires separate account for each system | One user ID and password allows user access to all RBIS systems along with other ORA systems. | Single Sign-On implemented 6/06. Users now login to FDA network and have full access to ORADSS without additional login. |
| 11 | 2007 | S.O. 2.2 - Protect the public against injuries and environmental threats | Customer Results | New Customers and Market Penetration | Number of ORADSS system users | ORADSS current number of users 100 | ORADSS will allow additional users to access data from multiple data sources in a timely fashion; expected number of users is 400. | Measure successfully completed. Over 4000 users have logged into ORADSS |
| 12 | 2007 | Effective Management of Human Capital/Information Technology/Resources | Technology | Operations and Maintenance Costs | Number of versions of Business Objects in use in Agency | Initial deployment is independent, with an older version of Business Objects. | Integrate ORADSS Business Objects user interface with FDA consolidated Architecture to reduce hardware cost and maintenance, so only one version is in use. | ORADSS has migrated to Agency standard version of Business Objects and meets architecture standards. |
| 13 | 2008 | S.O. 2.2 - Protect the public against injuries and environmental threats | Mission and Business Results | Population Health Management and Consumer Safety | Time required to locate (map) domestic firms of interest | Est. 10 min - using manual address/map lookup in Google Maps | <2 min to generate report and create map using Business Objects/MapInfo | Load test confirms 1-2 min to generate report + map. Pilot of MapInfo underway. |
| 14 | 2008 | S.O. 2.2 - Protect the public against injuries and environmental threats | Processes and Activities | Productivity | Ability to find Firm records provided by new Firm Finder, measured by number of parameters available for search. | Limited search screens are available in FACTS & OASIS, using 22 parameters and limited Boolean combinations | Increase available search parameters by 50% to improve specificity and flexibility in searches | Firm Finder will be implemented in July, 2008. Users can select from over 50 parameters with expanded Boolean combinations. |
| 15 | 2008 | S.O. 2.2 - Protect the public against injuries and environmental threats | Customer Results | Response Time | Response time to retrieve an inspection report. | Obtaining documents requires logging into District Servers with widely varying response times | Documents can be retrieved from local/regional storage at all ORA locations with delays beyond network bandwidth limitations of no greater than 30 seconds. | Load test confirms 1-2 min to generate report + map. Pilot of MapInfo underway. |
| 16 | 2008 | S.O. 2.2 - Protect the public against injuries and environmental threats | Technology | Internal Data Sharing | Number of documents in available in Documentum repository. | Documents must be obtained by logging into District Servers, not connected to the reporting system, none are in repository | 4 years of inspection documents in Repository (80,000 documents) | Will be addressed once MARCS components of SERS are in Production. |
| 17 | 2009 | S.O. 2.2 - Protect the public against injuries and environmental threats | Mission and Business Results | Border and Transportation Security | Percentage of new firm records created due to inability to match | Current process introduces ~10,000 records/week, including both new firms and duplicates | Reduce the % of new records created by 25% through improved tools and processes | 2009 Metric |
| 18 | 2009 | S.O. 2.2 - Protect the public against injuries and environmental threats | Processes and Activities | Efficiency | Number of instances of duplicated data with differing identifiers across Agency | TBD - data is scattered across Centers, requiring assessment during integration phase | Mapping to single identifier reduces instances of duplicates by 75% | 2009 Metric |
| 19 | 2009 | S.O. 2.2 - Protect the public against injuries and environmental threats | Customer Results | New Customers and Market Penetration | Number of Users from Centers other than ORA | TBD - usage will be assessed at time of implementation | Incorporation of data from Centers other than ORA allows usage by non-ORA users (25% increase in users) | 2009 Metric |
| 20 | 2009 | S.O. 2.2 - Protect the public against injuries and environmental threats | Technology | System Response Time | Time to access non-ORA documents | TBD - current system requires login to multiple systems | Reduce access time by 75% by integration with other DM systems | 2009 Metric |
| 21 | 2010 | S.O. 2.2 - Protect the public against injuries and environmental threats | Mission and Business Results | Border and Transportation Security | Percentage of duplicate firm records created from Customs feed | TBD - currently data from CBP does not contain a reliable and unique standard identifier | Implementation of FHA standard identifier eliminates 99% of duplicate records | 2010 Metric |
| 22 | 2010 | S.O. 2.2 - Protect the public against injuries and environmental threats | Customer Results | Response Time | Response time for most used queries | TBD - measure response times at start of FY | Tune queries and improve system to reduce top 20 queries to meet customer specifications (100%) | 2010 Metric |
| 23 | 2010 | S.O. 2.2 - Protect the public against injuries and environmental threats | Processes and Activities | Timeliness | Time Lag | Data is available in warehouse after next nightly extract (up to 24 hr delay) | Near Real-time availability - lag no more than 15 min for all critical data | 2010 Metric |
| 24 | 2010 | S.O. 2.2 - Protect the public against injuries and environmental threats | Technology | Reliability | Amount of system downtime | Current system outages occur for both planned (upgrades) and unscheduled (problem) outages | Improve redundancy and processes to reduce by 25% | 2010 Metric |
| 25 | 2011 | S.O. 2.2 - Protect the public against injuries and environmental threats | Technology | Data Reliability and Quality | Number of Systems Using Data Standardization/Validation Service | 1 System in Production in FY 2007 | All Critical Agency Systems in Production (number TBD once assessment complete) | 2011 Metric |
| 26 | 2011 | S.O. 2.2 - Protect the public against injuries and environmental threats | Processes and Activities | Knowledge Management | Data Mining Reports; number of reports available | No predictive analysis capability; no reports available | Data mining capability provides risk-based indicators for at least 2 critical areas (e.g., Firms and Shipments) with at least 1 report each | 2012 Metric |
| 27 | 2011 | S.O. 2.2 - Protect the public against injuries and environmental threats | Mission and Business Results | Population Health Management and Consumer Safety | Number of Queries (avg)/day | TBD - tool to audit to be procured | 5% increase/year | 2011 Metric |
| 28 | 2011 | S.O. 2.2 - Protect the public against injuries and environmental threats | Customer Results | Customer Retention | Number of ORADSS users | 4000 user accounts in FY 2007 | At least as many user accounts, adjusted for FDA staffing levels | 2011 Metric |
| 29 | 2012 | S.O. 2.2 - Protect the public against injuries and environmental threats | Technology | Reliability | System Availability | SLA's not established | SLA's established; all RBIS systems meet SLA's | 2012 Metric - systems are in Steady State (no new DME metrics) |
| 30 | 2012 | S.O. 2.2 - Protect the public against injuries and environmental threats | Mission and Business Results | Population Health Management and Consumer Safety | Number of Queries (avg)/day | TBD - tool to audit to be procured | 5% increase/year | 2012 Metric |
| 31 | 2012 | S.O. 2.2 - Protect the public against injuries and environmental threats | Customer Results | Customer Retention | Number of ORADSS users | 4000 user accounts in FY 2007 | At least as many user accounts, adjusted for FDA staffing levels | 2012 Metric |
| 32 | 2012 | S.O. 2.2 - Protect the public against injuries and environmental threats | Processes and Activities | Timeliness | Help desk response time | User calls are resolved in TBD days or less | All user calls are resolved in 5 business days or less | 2012 Metric |
| 33 | 2013 | S.O. 2.2 - Protect the public against injuries and environmental threats | Mission and Business Results | Population Health Management and Consumer Safety | Number of user report requests met | Requests are currently deferred due to competing priorities | 100% of valid requests for report maintenance met | 2013 Metric |
| 34 | 2013 | S.O. 2.2 - Protect the public against injuries and environmental threats | Customer Results | Customer Retention | Number of ORADSS users | 4000 user accounts in FY 2007 | At least as many user accounts, adjusted for FDA staffing levels | 2013 Metric |
| 35 | 2013 | S.O. 2.2 - Protect the public against injuries and environmental threats | Technology | Reliability | System Availability | SLA's not established | SLA's established; all RBIS systems meet SLA's | 2013 Metric |
| 36 | 2013 | S.O. 2.2 - Protect the public against injuries and environmental threats | Processes and Activities | Timeliness | Help desk response time | User calls are resolved in TBD days or less | All user calls are resolved in 5 business days or less | 2013 Metric |
| 37 | 2014 | S.O. 2.2 - Protect the public against injuries and environmental threats | Mission and Business Results | Population Health Management and Consumer Safety | Number of user report requests met | Requests are currently deferred due to competing priorities | 100% of valid requests for report maintenance met | 2014 Metric |
| 38 | 2014 | S.O. 2.2 - Protect the public against injuries and environmental threats | Customer Results | Customer Retention | Number of ORADSS users | 4000 user accounts in FY 2007 | At least as many user accounts, adjusted for FDA staffing levels | 2014 Metric |
| 39 | 2014 | S.O. 2.2 - Protect the public against injuries and environmental threats | Technology | Reliability | System Availability | SLA's not established | SLA's established; all RBIS systems meet SLA's | 2014 Metric |
| 40 | 2014 | S.O. 2.2 - Protect the public against injuries and environmental threats | Processes and Activities | Timeliness | Help desk response time | User calls are resolved in TBD days or less | All user calls are resolved in 5 business days or less | 2014 Metric |