Thursday, June 27, 2013

Parking Meter Performance Reports - June 1 - 24, 2012

June 1-24 2013 

Important notes:   Full June report will be available in early July.

Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail

Monday, June 17, 2013

Parking Meter Performance Reports - May 2013

May 2013 

Important notes:   Continued decline in the number of rejected meter numbers made to the Call Center. Current rejection rates have been reduced to approximately 4%. Review the top meter rejection list to ensure meter numbers are accurately labeled on meter equipment.

Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail
Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Parking Meter Performance Reports - April 2013

April 2013 

Important notes:   Continued decline in the number of rejected meter numbers made to the Call Center. Current rejection rates have been reduced to approximately 4%. Review the top meter rejection list to ensure meter numbers are accurately labeled on meter equipment.

Performance Report Results:
LATE: DashboardDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail
Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Thursday, April 11, 2013

Parking Meter Repair Performance Reports - March 2013

March 2013 

Important notes:   Continued decline in the number of rejected meter numbers made to the Call Center. Current rejection rates have been reduced to approximately 5%. Review the top meter rejection list to ensure meter numbers are accurately labeled on meter equipment.

Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail
Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Monday, March 18, 2013

Parking Meter Repair Performance - February 2013

February 2013 

Important notes:   Continued decline in the number of rejected meter numbers made to the Call Center. Current rejection rates have been reduced to approximately 5%. Review the top meter rejection list to ensure meter numbers are accurately labeled on meter equipment.

Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail
Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Tuesday, February 12, 2013

Performance Monitoring Reports - January 2013

January 2013 

Important notes:   Continued decline in the number of rejected meter numbers made to the Call Center. Current rejection rates have been reduced to approximately 5%. Review the top meter rejection list to ensure meter numbers are accurately labeled on meter equipment.

Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail
Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Wednesday, January 23, 2013

Performance Monitoring Reports - December 2012

December 2012 

Important notes:   Continued decline in the number of rejected meter numbers made to the Call Center. Current rejection rates have been reduced to approximately 5%. Review the top meter rejection list to ensure meter numbers are accurately labeled on meter equipment.

Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail
Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Wednesday, December 19, 2012

Performance Monitoring Reports - November 2012

November 2012 

Important notes:   With the meter renumbering project complete, there appears to be a significant improvement with the number of rejected meter numbers made to the Call Center. Prior to this effort, a monthly rejection rate of 18-20% was common. Current rejection rates have been reduced to approximately 8% rejected. Review the top meter rejection list to ensure numbers are accurately labeled on meter equipment.

Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail
Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Wednesday, November 21, 2012

Performance Monitoring Reports - October 2012

October 2012 

Important notes:   Hurricane Sandy shut down DC Government operations on Monday October 30 and Tuesday October 31, 2012.  Thus, Xerox parking meter repairs were not performed during this period.  Any assessment fees for this period should be adjusted as necessary to reflect this revised operation schedule.  The impact of Hurricane Sandy may also appear in early November 2012.

Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail
Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Performance Monitoring Reports - September 2012

September 2012 
Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail
Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Friday, September 28, 2012

Performance Monitoring Results - August 2012

August 2012 
Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail
Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Tuesday, August 28, 2012

Performance Monitoring Results - July 2012

July 2012 
Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail
Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Thursday, July 19, 2012

Performance Monitoring Results - June 2012

June 2012 
Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail
Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Sunday, June 17, 2012

Monday, May 21, 2012

Sunday, April 22, 2012

Monday, February 27, 2012

Monday, January 16, 2012

Tuesday, December 20, 2011

Tuesday, November 29, 2011

Sunday, October 23, 2011

Friday, September 23, 2011

Monday, May 23, 2011

Thursday, April 21, 2011

Parking Meter Performance Monitoring Results: March 2011

March 2011 



Liquidated Damages: $1,578.72
Performance Report Results:
LATE: DashboardSummaryDetail
Multi Space Operability: DashboardSummaryDetail,
Single Space Operability: DashboardSummaryDetail

Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Wednesday, March 23, 2011

Thursday, February 17, 2011

Monday, January 17, 2011

Thursday, December 23, 2010

Wednesday, December 22, 2010

Parking Meter Performance Monitoring Results: October 2010

October (*recreated 12/23/2010 - excludes PILOT vendor repairs)
Performance Report Results:
LATE: Dashboard, Summary, Detail
Multi Space Operability: Dashboard, Summary, Detail
Single Space Operability: Dashboard, Summary, Detail

Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Tuesday, September 28, 2010

Parking Meter Performance Monitoring Results: August 2010

Overall Analysis:

August Liquidated Damages ($107.64) stem from LATE issues. The report excluded the current PILOT meter program (multispace).

Performance Report Results:
LATE: Dashboard, Summary, Detail
Multi Space Operability: Dashboard, Summary, Detail
Single Space Operability: Dashboard, Summary, Detail

Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Thursday, August 26, 2010

Parking Meter Performance Monitoring Results: July 2010

Overall Analysis:

July Liquidated Damages ($3420.56) stem from LATE issues. The report excluded the current PILOT meter program (multispace).

Performance Report Results:
LATE: Dashboard, Summary, Detail
Multi Space Operability: Dashboard, Summary, Detail
Single Space Operability: Dashboard, Summary, Detail

Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Tuesday, July 13, 2010

Parking Meter Performance Monitoring Results: June 2010

Overall Analysis:

June Liquidated Damages ($7502.51) stem from Multi Space Operability issues. Late repairs account for LDs of ($2116.92).

It is noteworthy that iSLIMS experienced technical downtime between Saturday 6/26/2010 at 12AM and service was restored Monday 6/28/2010 at 5PM EST. In order to provide ACS with a fair allowance for this time period, the ACS field work complete dates - were applied to iSLIMS completion dates - in order to CLOSE iSLIMS work tickets between 6/25 and 6/28. The ACS tickets in question were provided by ACS IT Staff in a batch transmission. It is further noteworthy, that NONE of the LD's for JUNE were within the 6/26 and 6/28 down time period.

Meter operability is based on a CORRECT count of parking meter assets in the meter inventory. Currently, this meter count (and meter inventory) REMAINS INFLATED for single space meters at 14,282. Meter inventory for multi space meters is 509.

Well over 50% of all meter calls for service -- resulted in NO FOUND PROBLEMS from the ACS repair technician. This means, that of all issues reported by DC citizens, less than half of these calls were actual malfunctions.

Performance Report Results:
LATE: Dashboard, Summary, Detail
Multi Space Operability: Dashboard, Summary, Detail
Single Space Operability: Dashboard, Summary, Detail

Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Issues:

1. Top rejections due to invalid meter number is just approx 12%. This means that 12% of all service request were for "invalid" parking meters - meters that are not "defined" in the ACS inventory. It appears that much of this is "bad data" that is being passed from the Call Center system to CityWorks.

Monday, June 14, 2010

Parking Meters Performance Monitoring Results: May 2010

Overall Analysis:

May Liquidated Damages ($108.84) stem from Multi Space Operability issues. Less than $100 of LATE performance for May 2010, results in the greater liquidated damages coming from Multi Space operability.

Meter operability is based on a CORRECT count of parking meter assets in the meter inventory. Currently, this meter count (and meter inventory) REMAINS INFLATED for single space meters at 14,261. Meter inventory for multi space meters is 509.

Well over 50% of all meter calls for service -- resulted in NO FOUND PROBLEMS from the ACS repair technician. This means, that of all issues reported by DC citizens, less than half of these calls were actual malfunctions.

Performance Report Results:
LATE: Dashboard, Summary, Detail
Multi Space Operability: Dashboard, Summary, Detail
Single Space Operability: Dashboard, Summary, Detail

Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Issues:

1. Top rejections due to invalid meter number is just approx 11%. This means that 11% of all service request were for "invalid" parking meters - meters that are not "defined" in the ACS inventory. It appears that much of this is "bad data" that is being passed from the Call Center system to CityWorks.

2. The new CityWorks/CSR application is automatically CLOSING parking meter repair requests BEFORE the request is provided to ACS via iSLIMS. The citizen making the request is under the impression that the work is being repaired, when in fact the repair request is prematurely closed. The number of service requests, and the overall percentage affected is unknown, but the issue was identified in mid-November and is awaiting resolution by DDOT IT

Wednesday, May 19, 2010

Parking Meters Performance Monitoring Results: April 2010

Overall Analysis:

April Liquidated Damages ($4,305.60) stem entirely from LATE servicing of requests. The performance results for April 2010 indicate NO meter operability issues or assessed damages for single space or multi space meters.

Meter operability is based on a CORRECT count of parking meter assets in the meter inventory. Currently, this meter count (and meter inventory) REMAINS INFLATED for single space meters at 14,274. Meter inventory for multi space meters is 509.

51% of all meter calls for service -- resulted in NO FOUND PROBLEMS from the ACS repair technician. This means, that of all issues reported by DC citizens, only 49% of these calls were actual malfunctions.

Note: February results that appear in this report were NOT revised for SNOW or POWER outage issues that appeared on the prior (February) reporting results. The Feb numbers do not affect APRIL reporting.

Performance Report Results:
LATE: Dashboard, Summary, Detail
Multi Space Operability: Dashboard, Summary, Detail
Single Space Operability: Dashboard, Summary, Detail

Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Issues:

1. Top rejections due to invalid meter number is just approx 11%. This means that 11% of all service request were for "invalid" parking meters - meters that are not "defined" in the ACS inventory. It appears that much of this is "bad data" that is being passed from the Call Center system to CityWorks.

2. The new CityWorks/CSR application is automatically CLOSING parking meter repair requests BEFORE the request is provided to ACS via iSLIMS. The citizen making the request is under the impression that the work is being repaired, when in fact the repair request is prematurely closed. The number of service requests, and the overall percentage affected is unknown, but the issue was identified in mid-November and is awaiting resolution by DDOT IT

Tuesday, April 13, 2010

Parking Meters Performance Monitoring Results: March 2010

Overall Analysis:

March Liquidated Damages ($8,706.88) stem entirely from LATE servicing of requests. The performance results for March 2010 indicate NO meter operability issues or assessed damages for single space or multi space meters.

Meter operability is based on a CORRECT count of parking meter assets in the meter inventory. Currently, this meter count (and meter inventory) REMAINS INFLATED for single space meters at 14,435. Meter inventory for multi space meters have increased to 509.

51% of all meter calls for service -- resulted in NO FOUND PROBLEMS from the ACS repair technician. This means, that of all issues reported by DC citizens, only 49% of these calls were actual malfunctions.

Note: February results that appear in this report were NOT revised due to SNOW or POWER outage issues that appeared on the prior (February) reporting results. The Feb numbers appearing in the March performance reports, do not affect MARCH reporting.

Performance Report Results:
LATE: Dashboard, Summary, Detail
Multi Space Operability: Dashboard, Summary, Detail
Single Space Operability: Dashboard, Summary, Detail

Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Issues:

1. Top rejections due to invalid meter number is just over 13%. This means that 13% of all service request were for "invalid" parking meters - meters that are not "defined" in the ACS inventory. It appears that much of this is "bad data" that is being passed from the Call Center system to CityWorks.

2. The new CityWorks/CSR application is automatically CLOSING parking meter repair requests BEFORE the request is provided to ACS via iSLIMS. The citizen making the request is under the impression that the work is being repaired, when in fact the repair request is prematurely closed. The number of service requests, and the overall percentage affected is unknown, but the issue was identified in mid-November and is awaiting resolution by DDOT IT

Monday, March 22, 2010

Parking Meters Performance Monitoring Results: February 2010

Overall Analysis:

Revised 3/30/2010 for ACS Power Outage Feb 8 & 9

February Liquidated Damages ($5,645.12) stem entirely from LATE servicing of requests. The performance results for February 2010 indicate NO meter operability issues or assessed damages for single space or multi space meters.

The District of Columbia government was shut down on Feb 10 and 11, 2010 due to snow. In addition, ACS was without power for the period Feb 8 and 9, 2010. Any work request that was originally DUE on either of these days, were adjusted to Feb 12, 2010 thru Feb 15.

Meter operability is based on a CORRECT count of parking meter assets in the meter inventory. Currently, this meter count (and meter inventory) REMAINS INFLATED for single space meters at 14,449. The actual count is under 13,000 meters. Thus, all single space meter operability reports-- return inflated meter operability for single space meters.

Multi space meter counts appears to be corrected by ACS from prior month values. The problems with obtaining a correct meter inventory remain ongoing issues between the District and ACS.

Another noteworthy item - is that 51% of all meter calls for service -- resulted in NO FOUND PROBLEMS from the ACS repair technician. This means, that of all issues reported by DC citizens, only 49% of these calls were actual malfunctions. Over half, are nonissues.

Performance Report Results:
LATE: Dashboard, Summary, Detail
Multi Space Operability: Dashboard, Summary, Detail
Single Space Operability: Dashboard, Summary, Detail

Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Issues:

1. Top rejections due to invalid meter number is at 13%. This means that 13% of all service request were for "invalid" parking meters - meters that are not "defined" in the ACS inventory.

2. The new CityWorks/CSR application is automatically CLOSING parking meter repair requests BEFORE the request is provided to ACS via iSLIMS. The citizen making the request is under the impression that the work is being repaired, when in fact the repair request is prematurely closed. The number of service requests, and the overall percentage affected is unknown, but the issue was identified in mid-November and is awaiting resolution by DDOT IT

Thursday, February 25, 2010

Parking Meters Performance Monitoring Results: January 2010

The performance results for January 2010 indicate NO meter operability issues. Meter operability is based on a CORRECT count of parking meter assets in the meter inventory. Currently, this meter count (and meter inventory) REMAINS INFLATED and INCORRECT -- resulting in better than expected results for meter operability. The problems with obtaining a correct meter inventory remain ongoing issues between the District and ACS.

Performance Report Results:
LATE: Dashboard, Summary, Detail
Multi Space Operability: Dashboard, Summary, Detail
Single Space Operability: Dashboard, Summary, Detail

Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Unresolved Issues:

1. Top rejections due to invalid meter number. It appears that either the CSR (Call Center) or CityWorks has modified their process - and is no longer sending (during the month of December) to iSLIMS invalid meter numbers. It is unfortunate that CSR or CityWorks has modified this process without collaboration, as iSLIMS will no longer be able to provide feedback to ACS as to which meters may be mis-labeled.

2. The new CityWorks/CSR application is automatically CLOSING parking meter repair requests BEFORE the request is provided to ACS. The citizen making the request is under the impression that the work is being repaired, when in fact the repair request is prematurely closed. The number of service requests, and the overall percentage affected is unknown, but the issue was identified in mid-November and is awaiting resolution by DDOT IT.

3. The multi space operability numbers for December and January have shown an unusual trend - in that there are NO multi space meter operability issues. The values indicate a red flag - and should be investigated to determine the reason for the change. For example, the results posted for NOVEMBER, no longer match the 90 day results (which include November). The inventory counts for multi space have been reduced to 503 for this month - and single space numbers are now under 15,000. Single space numbes remain inflated - as approx 12,500 is the expected inventory count. ACS has been unable to provide a clean inventory of meter assets to DDOT despite repeated requests. The current meter inventory assets are inflated, which in turn results in operability numbers that appear better than actual results.

Tuesday, January 12, 2010

Parking Meters Performance Monitoring Results: December 2009

The performance results for December 2009 indicate NO meter operability issues. Meter operability is based on a CORRECT count of parking meter assets in the meter inventory. Currently, this meter count (and meter inventory) is INFLATED and INCORRECT -- resulting in better than expected results for meter operability. The problems with obtaining a correct meter inventory remain ongoing issues between the District and ACS.

Performance Report Results:
LATE: Dashboard, Summary, Detail
Multi Space Operability: Dashboard, Summary, Detail
Single Space Operability: Dashboard, Summary, Detail

Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Unresolved Issues:

1. Top rejections due to invalid meter number. It appears that either the CSR (Call Center) or CityWorks has modified their process - and is no longer sending (during the month of December) to iSLIMS invalid meter numbers. It is unfortunate that CSR or CityWorks has modified this process without collaboration, as iSLIMS will no longer be able to provide feedback to ACS as to which meters may be mis-labeled.

2. The new CityWorks/CSR application is automatically CLOSING parking meter repair requests BEFORE the request is provided to ACS. The citizen making the request is under the impression that the work is being repaired, when in fact the repair request is prematurely closed. The number of service requests, and the overall percentage affected is unknown, but the issue was identified in mid-November and is awaiting resolution by DDOT IT.

3. ACS has been unable to provide a clean inventory of meter assets to DDOT despite repeated requests. The current meter inventory assets are inflated, which in turn results in operability numbers that appear better than actual results. For example, multi space meters appear in ACS inventory as 560, where the actual known physical number of multi space meters is at 503. Single space meters appear in ACS inventory as over 15,000 - when the actual known physical number of single space meters are closer to 12,500.

Sunday, December 20, 2009

Parking Meters Performance Monitoring Results: November 2009

The performance results for November 2009 indicate only 14 meters were repaired late (at a liquidated damages penalty of $167.44) , and meter operability results were in the acceptable range of 99% for multi space meters and 97% for single space meters.

Performance Report Results:
LATE: Dashboard, Summary, Detail
Multi Space Operability: Dashboard, Summary, Detail
Single Space Operability: Dashboard, Summary, Detail

Other Report Results:
Most frequently reported Meters Reported for Repairs
Top Repairs Made
Top Rejections due to invalid meter number

Unresolved Issues:

1. The new CityWorks/CSR application is automatically CLOSING parking meter repair requests BEFORE the request is provided to ACS. The citizen making the request is under the impression that the work is being repaired, when in fact the repair request is prematurely closed. The number of service requests, and the overall percentage affected is unknown, but the issue was identified in mid-November and is awaiting resolution by DDOT IT.

2. ACS has been unable to provide a clean inventory of meter assets to DDOT despite repeated requests. The current meter inventory assets are inflated, which in turn results in operability numbers that appear better than actual results. For example, multi space meters appear in ACS inventory as 560, where the actual known physical number of multi space meters is at 503. Single space meters appear in ACS inventory as over 15,000 - when the actual known physical number of single space meters are closer to 12,500.

Saturday, November 14, 2009

Performance Monitoring Reports (Parking Meters)

The District of Columbia Department of Transportation implemented upgrades to it's performance monitoring reports of the ACS contract for Parking Meters - to better enable visibility of information, and improve the accuracy of it's reporting. These new reports were implemented effective July 2009 for assessment of monthly Liquidated Damages.

Some of the challenges in accurately tracking and monitoring the repair activity of Parking Meters has to do with the different methods in which information is tracked - from the Call Center citizen requests for services, to work tickets in the District's work order system, to meter monitoring by the vendor ACS.

For example, 15 calls for service to the same meter number, does not translate to 15 meters being inoperable. In this case, ONE meter is inoperable, even though there may be 15 requests for service, and 15 work orders generated. The challenge is to reconcile these numbers, so that the vendor is accurately, and fairly assessed for meter operability issues and late repairs - based on the number of METERS out of service.

The major portion of the reporting upgrades, reconciled the calls and duplicate calls for the same meter - so that liquidated damages could be more accurately assessed. New reporting features include:

  • Executive Dashboard style reports that display a weekly, 30 day and 90 day summary of repair and operability
  • Summary style report that provide quick visibility to liquidated damages
  • Detail style reports that support the charges listed in any of the above reports
  • Top Rejected Meter report - that lists the top 30 meters that were REJECTED by the District's work order system because there was no meter asset defined in the inventory. This report helps to understand if there may be a labeling issue, or inventory issue, or excessive parking ticketing issue.
  • Top Reported Meters for Repair. This new exception report identifies the top 30 meters that were reported during the last 90 days for repairs. This information assists DDOT / ACS in identifying meters that require excessive repairs.
  • Top REPAIRs made to meters. This new exception report identifies the top 30 repairs that ACS reports to all meter issues during the past 90 days. This information assists DDOT / ACS in identifying how meters are serviced.
At the end of each month, new reports will be posted to this site - that enable both DDOT and ACS to easily download and review the meter repair activities. Click on any of the links below to access the .PDF files for the indicated month.

Month(s) Late Repairs Multi Space Operability Single Space Operability Monitoring Exceptions
October 2009 Dashboard

Summary

Detail
Dashboard

Summary

Detail
Dashboard

Summary

Detail
Top Meter Issues

Top Repairs

Top Rejections
September 2009 * Dashboard

Summary

Detail
Dashboard

Summary

Detail
Dashboard

Summary

Detail
Top Meter Issues

Top Repairs

Top Rejections
July - August 2009 *Note: District Migration to new Call Center resulted is repair delays due to new Call Center from 8/23-8/31 Dashboard

Summary

Detail
Dashboard

Summary

Detail
Dashboard

Summary

Detail
Top Meter Issues

Top Repairs

Top Rejections

Sunday, October 4, 2009

Scorecard Performance Monitoring (StreetLights)

The Street Light Performance SCORECARD is directly impacted by THREE types of iSLIMS changes:
  1. PROBLEM PROFILE CHANGES (located under iSLIMS setup): This includes changes to PERFORMANCE GROUPING, # days allowed for response, # days allowed for quick turn, the percentage number used to evaluate which SCORE (#5 thru #1) must meet.

  2. DAILY WORK TICKET LINE ITEM COMPLETIONS: Work ticket line items are created, and closed daily. When the Score Card report is run, if a work ticket is OPEN for the time frame selected - it is not included into the scorecard result. When the Score Card is run the next day, or weeks later or even a year later -- when a work ticket is CLOSED - (and the line item is associated with a PERFORMANCE GROUP (defined above)) - then it will get included in the ScoreCard result.

    As of this writing (10.4.2009) there are OPEN LINE ITEMS in iSLIMS that date back to 2006. When these line items get closed -- it affects HISTORICAL data - because there were created some time back.

    Also, batch data changes (such as changing "Defective Fixture" to a different problem, or adding T-Base issues for selected tickets behind the scenes) will further impact these line items. Thus, just when you thought the Score Card was "final" -- as soon as new batched data is implemented - the score card is re-run showing the NEW results.

  3. SOFTWARE CHANGES: Those changes that affect how a DUE DATE for a work order line item is generated or calculated, and those changes over the span of 3 years that affects the calculation and display of Score Card results. The Score Card result has been a collaborative process - and the algorithms CURRENTLY used can be seen via this link.
Below is an iSLIMS Time line that summarizes how changes OVER TIME to the above criteria impacts the Score Card Performance Monitoring Report. This will hopefully show why criteria in use TODAY -- is different from PAST YEARS - and thus Score Cards generated in the past will display different values from those generated today.

This timeline is important, because depending on WHEN a Score Card report was generated - the values in the score card get adjusted (fine tuned) or corrected based on DDOT requirements. Thus, once any changes are made that affect the problem profile, daily work order line item completions or software changes - the Score Card will be reflected accordingly to display the new results. It would be correct to interpret that the SCORE CARD has evolved over time - and continues to be FLUID depending on how the variables are modified.
  • March 2006: iSLIMS was launched inHOUSE (within the DC intranet) for DDOT and vendor to enter and track repairs based on citizen complaints imported nightly via Hansen

  • June 2006: iSLIMS was launched to the WEB for Street Lights to monitor the repairs of Street Lights by it's vendor. At this time, PERFORMANCE GROUPS (such as PM 2 thru 69) had NOT been defined within iSLIMS. DDOT was working on translating the PM contract requirements ...into values that could be incorporated into iSLIMS. No Scorecard is available as the criteria has not been defined.

  • May 2007: Hansen tickets that were closed by the vendor, are automatically CLOSED. DDOT no longer has to close tickets both in iSLIMS and Hansen

    End of Contract Year 1. DDOT attempts to create PERFORMANCE GROUPS for problems - so that a SCORECARD can be developed.

  • July 2007: iSLIMS is modified to include PERFORMANCE GROUPING -- and problems are updated to become associated with these PERFORMANCE GROUPS. A field for PERFORMANCE GROUPING is added to the PROBLEM PROFILE. This allows DDOT to group problems into PM 2 thru 60.

  • August 2007: Draft of SCORECARD is created offline, and made available to DDOT only. DDOT is concerned that performance groups are not yet fully vetted - and is not ready to share the ScoreCard results with Severn. There is also concern that work tickets are still OPEN (especially for those problems that have a longer turnaround) - and thus the numbers for the ScoreCard change, as tickets get closed over time.

    DDOT is concerned about the number of work order LINE ITEMS that remain open, even tho the work order itself has been CLOSED. We resolve this by: (a) automatically closing all line items that show outstanding - when the work order itself was closed and (b) modifying the iSLIMS software, so that when a work order gets closed -- all associated line items get closed with it.

  • November 2007: DDOT discovers that Severn is using a problem called "Defective Fixture" that allows 30 days for response, instead of a more common problem with a 5 day turnaround. DDOT requests an automatic update of all work tickets that include problems with "Defective Fixture"....and re-assign these to "Install Fixture" that has a 5 day turnaround. All due dates were modified for these work tickets. This meant that THOSE AFFECTED work tickets that previously displayed a "Defective Fixture" problem ON time, may now report that same problem (changed to "Install Fixture") as being late.

  • December 2007: Severn has expressed concern that whenever they create a new work order LINE ITEM - it creates a DUE DATE based on the original entry date of the work order. For example, if a work ticket is created 12.1.2007.....and on 12.15.2007 Severn adds a new line item...(such as "light out")....then the line item will appear as being due on 12.6.2007....instead of 12.21.2007. Thus, the moment Severn enters a new line item with a short turnaround (in this case) -- it is automatically OVERDUE.

    DDOT's position is - that they don't want Severn to linger on repairing the work ticket, and by allowing Severn to create a due date base on 12.15.2007 entry -- would simply give them more time. Thus, DDOT wants to hold Severn accountable to the original dates.

    With that said, DDOT requested a software update to iSLIMS - that would allow DDOT to determine if SOME problems (such as "Light Out") could get created based on the DATE ENTERED as opposed to the ORIGINAL work order date. This update was implemented, and allows DDOT to toggle a switch in the PROBLEM PROFILE for this purpose. As of this writing -- all switches in the PROBLEM PROFILE are set to using the original WORK ORDER date to base the due date of any line item entered.

    Here is the impact: Using the above example, if the repair turns out to be substantial, then Severn would be better off (in terms of the Score Card) - to simply close out the work order...and create a new one. If Severn were to use the original Work Order, then they are dinged each time for any line item entered -- as being late before they can even make the repair. This may be precisely how DDOT wants this to work -- but it is important to understand the impact on the vendor as well.

  • January, 2008: DDOT continues to revise the PROBLEM PROFILE, and especially the performance grouping. "Photo Cell Hanging" is added to the list, and those problems that are deemed "obsolete" are removed. Extensive analysis is performed to determine which problems SEVERN is most likely to use, and which problems DDOT would like Severn to use. As adjustments are made to the Performance Grouping, and other profile values - the Score Card displays new results. The SCORE CARD continues to be created offline -- allowing DDOT and SAIC to review the results prior to distributing to Severn.

  • March, 2008: The amount of data stored and displayed on iSLIMS Crystal reports begins to create performance problems for iSLIMS. Street Light data prior to March 2006 is archived from the primary database. Still, large reports are giving iSLIMS the blues. It is determined that in order to prevent the iSLIMS server from crashing - we must temporarily limit the number of days in which a report can be run - to 30 days. Thus, DDOT and Severn can run reports -- but only in 30 day segments. The Performance Score Card is now being run on a monthly frequency - tho it still remains OFFLINE - and is provided to DDOT and SAIC for their review.

  • September 2008: Efforts begin to replace CRYSTAL reports (which has limited the reporting timeframe) with a product that allows large reports to be generated, and better number crunching. All iSLIMS reports undergo upgrades to use this new "report generator" -- and the Score Card report is coded to be available ONLINE.

  • December 2008: All iSLIMS reports have been re-coded with the new report generator - and graphs are included on reports to show trends. The Score Card report is now available ONLINE -- allowing ANY user with report access to see the results of the score card at any time.

  • January, 2009: SAIC notes a discrepancy in the algorithm between the OFFLINE score card results, and the ONLINE version. This affected SCORE #4 results, and was modified so that anything with a #4 - was further evaluated for ANY LATE tickets. A new version of iSLIMS with this modification was published - and shared with SAIC/DDOT.

  • September, 2009: No software changes to the Street Lights SCORE CARD have been implemented since January, 2009.

    When Score Card results for RECENT HISTORY (past 9 months) are compared on a weekly or monthly basis - there are only 2 FACTORS that would contribute to the display of different values. These 2 factors are: Changes to the PROBLEM PROFILE or CLOSING out open and overdue LINE ITEMS.

    It is especially noteworthy, that when RECENT months are reviewed using the MONTHLY SCORE CARD results, these recent months are especially susceptible to work order LINE ITEMS changes. For example, if you were to run a MONTHLY SCORE CARD for a month ending 2 days ago....and then compare the results when run again 15 days later -- it is HIGHLY likely that many of the problems were not complete the first time the report was run. Depending on how TIMELY Severn is in completing work order line items -- you may continue to note different results in the Score Card - as each of these line items eventually gets included onto the report. This is probably why in the original days of the Score Card deployment, DDOT would hold onto the results until numerous months have passed -- to allow work line items to get complete, and reduce the variablity of the Score Card results.

    But wait! What about running a Score Card for Contract Year 2....and then a few months later -- why are the numbers changing? As long as there are OPEN and LATE work line items that exist for those years -- and assuming that there are NO changes to the PROBLEM PROFILE or Software changes -- then YES, these numbers will continue to fluctuate. Should any changes to the PROBLEM PROFILE get made as well, then you now have TWO factors that affect the values.

    When Score Card that were generated offline for PRIOR contract years are compared with a "NOW" online printout - it will be VERY difficult to achieve identical results. The 3 factors that contribute to the Score Card have evolved extensively over time. This is due to PROFILE CHANGES made over a 3+ year time frame, Work Ticket Line items that are closed NOW, but were not completed at the time of a prior report and software changes that has evolved to refine the algorithms, and to make the Score Card report available anytime, online.

Below is an analysis of the data (as a snapshot of the iSLIMS database on 10/2/2009 at 11:45PM) as it affects the ScoreCard in general, and specifically for PM02:


  • PM 02 is composed of the following individual "problem options"
    ?? (a catch all problem item when the problem is not yet known)
    (Install Fixture)
    (Light off/on)
    (Light out)
    (Light out-Defective Fixture)
    (Photo Cell Hanging)

  • Few changes have been made to the Problem PROFILEs since 12.22.2008. A new problem code was entered on 9.25.2009 by J.Blevins for "Repair holes for Crown". As of this writing - this new code is NOT associated with a Performance Group - and thus would not affect the Scorecard. However, it it were to be added at a later date to a performance group - this will alter the work order COUNTS that get applied to the scorecard report.

  • PM02: There are 208 work order line items that are OPEN and LATE in iSLIMS since 2006. This means the work is showing "Not done". My preliminary review of these work tickets - is that much of the information was probably inaccurately entered. For example, a problem may display "Install Fixture" - with comments saying "refer to DDOT", yet the assignment still shows to be Severn. When these tickets are eventually CLOSED - they will get added into the Performance Score Card result based on the ENTRY DATE of the WORK ORDER. Click here for more details. Is Severn really working on these tickets -- or did they simply fall thru the cracks?

  • PM02: There are over 4000 line items since June 3, 2006 that were completed LATE - many of them significantly overdue. These tickets presently appear on Score Card results -- again, based on the ENTRY DATE of the WORK ORDER.

  • ALL Performance Groups Analysis: The last worksheet displays ALL work ticket line items that are LATE. These tickets may be still OPEN (not completed yet) or CLOSED. If they are closed -- the line item is factored into the Score Card. If the ticket is still OPEN -- it does not appear on the scorecard until closed.

As you can see -- for those work order line items that are EXTENSIVELY late -- as soon as the work is completed -- the historical ScoreCard data is adjusted to reflect the change. This is why any and all history can CHANGE over time.

This is why Severn feels that the reports are inconsistent over time. But the "Data-reality" is that there are MANY OPEN AND LATE WORK ORDER line items - and when these do not get closed out in a timely manner -- they affect historical results and scorecard results at a later date.

Moving forward -- Items for DDOT to consider:

  • If a FIXED SCORECARD result (one that won't change over time / and is not dependant on the date the work order was recieved) is preferred over potentially dynamic data - this can be accomplished by altering how dates are being evaluated for the report.

    For example, Instead of evaluating the work order line item by the WORK ORDER ENTRY DATE (current method), the line item could be evaluated by the COMPLETION date. Thus, the values in the reports will remain consistent over time. (i.e. only those line items completed in June 2009 -- will appear in the June 2009 Scorecard. A month, or year later -- those results will never vary - because you can't add more work tickets completed in June 2009 - once June 2009 has passed).

  • LOCK DOWN the Problem PROFILE feature. Only 1 DDOT Superuser individual should have access to this feature. The potential for accidental adjustments -- and the impact it could have on Performance Reports is quite risky.

  • DDOT and SEVERN should frequently run the PROBLEM DETAIL report, and choose the LATE option on the Command Center. Choose a date range from 6/2006 to present. This helps to keep an eye on work tickets that start to fall thru the cracks -- before years go by.