1 / 51

P05 – Trigger Upgrade: 401.4

P05 – Trigger Upgrade: 401.4. Wesley Smith, U. Wisconsin L2 Manager, WBS 401.4 August 26, 2013. L1 Trigger Upgrades & Inputs. Endcap Muon Detectors CSC, RPC. Hadron Calorimeter HCAL. Electromagnetic Calorimeter ECAL. Not shown (off-detector) Muon Trigger Calorimeter Trigger.

ray
Download Presentation

P05 – Trigger Upgrade: 401.4

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. P05 – Trigger Upgrade: 401.4 Wesley Smith, U. Wisconsin L2 Manager, WBS 401.4 August 26, 2013 CD-1 Review -- P05: Trigger Upgrade

  2. L1 Trigger Upgrades & Inputs Endcap Muon Detectors CSC, RPC Hadron Calorimeter HCAL Electromagnetic Calorimeter ECAL • Not shown (off-detector) • Muon Trigger • Calorimeter Trigger 401.04 CD-1 Review -- P05: Trigger Upgrade

  3. Outline • Conceptual Design • Trigger Overview • Muon Trigger • Calorimeter Trigger • Project Organization and Management • ESH&Q • Scope • Schedule • Risk • Cost • Summary CD-1 Review -- P05: Trigger Upgrade

  4. Conceptual Design CD-1 Review -- P05: Trigger Upgrade

  5. L1 Trigger Upgrade – overview • LHC beams cross every 25 ns with ~ 23 interactions → 0.5 MB of data, but can only store ~ 1 kHz of 0.5 MB data → Trigger • Trigger rates are driven by the increase in luminosity, the center-of-mass energy, and by higher Pile-Up (PU) • Detector readout systems limit Level-1 trigger output rate to 100 kHz, latency to 4 μsec. • Mitigate by improving e/γ isolation, τ id, μ pT resolution, μ isolation, jets with PU subtraction and L1 menu sophistication • Increase system flexibility with high bandwidth optical links and large FPGAs, and standardize on μTCA telecom standard • Build and commission upgrade in parallel with current trigger system to safeguard physics, decouple from LHC schedule • Overall design: • Two-layer calorimeter trigger with tower-level precision and PU subtraction • Integrated muon trigger combining all CSC, DT and RPCs in track-finding CD-1 Review -- P05: Trigger Upgrade

  6. Upgrade Trigger Physics Performance • Physics priorities: • Measure all Higgs BR precisely to confirm Standard Model or not ⇒ retain or improve current trigger capability critical • Want to be able to answer question of naturalness - whether or not there is new physics stabilizing Higgs mass • SUSY remains a leading candidate, but if so, must have light stops • Also must be able to trigger on and search for all variants (e.g. RPV with all hadronic final states) to draw a firm conclusion • Studied a set of benchmark physics channels • Looked at performance of these channels in 2012 analyses with and without L1 trigger upgrade at different luminosities • Based on a simplified trigger menu with a total rate < 100 kHz • Results for luminosities up to 2.2 x 1034 cm–2 s–1 • Acceptance Improvements > x 2 in some channels for same rate • Average Improvement 40% • Results summarized in breakout sessions CD-1 Review -- P05: Trigger Upgrade

  7. Final Overall Upgrade Scheme ↑HCAL Upgrade↑ LHC CMS Detector Upgrade Project ↓Trigger Upgrade↓ (Cluster Finding) Trigger Upgrade (Object Finding) CD-1 Review -- P05: Trigger Upgrade

  8. Install fully paralleland higher bandwidthoptical path for CSC New CSC Muon Port Cards mezzaninecards installed in cavern during LS1 Operations Program Alleviates bottleneck and send all segments from each CSC (robustness to PU and collimated signals) Build up new Track Finder in 2015 and commission in parallel, ready by 2016 Muon Trigger Transition New system Old system CD-1 Review -- P05: Trigger Upgrade

  9. 401.04.03 EMU Trigger Upgrade Cavern Counting Room Trigger MotherBoard Clock & Control Data MotherBoard Muon Sorter Clock&Control VME Sector Processors 401.04.03.04 Endcap Muon Track-Finder (U. Florida) 401.04.03.02 Muon Port Card Mezzanine* (Rice) 401.04.03.03 MPC-EMUTF Optical Fibers* (Rice) *M&S on FY13 Ops. Prog. μTCA: Advanced Mezzanine Cards from Telecommunications Computing Architecture (commercial telecommunications hardware) 401.04.03.05 EMUTF Infrastructure (U. Florida) 401.04.03.06: Muon Sorter (Rice) CD-1 Review -- P05: Trigger Upgrade

  10. Muon Track Finder processor: MTF7 13 needed + 4 spares + 3 test setups = 20 Optimized for maximum input from muon detectors (84 input links, 24 output links) Dual card with large capacity for RAM (~1GB) to be used for pT assignment in track finding Current prototype based on Virtex 6 FPGAis undergoing final tests Virtex 7 FPGA design is ~75% done, expected late 2013 401.04.03.04: EMU Track-Finder(U. Florida) Front: Optics card Back: Core FPGA cardwith PT LUT mezzanine CD-1 Review -- P05: Trigger Upgrade

  11. ECAL Energy(TCC) HCAL Energy(HTR) Regional Calo Trigger Global Calo Trigger HF Energy(μHTR) HCAL Energy(μHTR) Current L1 Trigger System Upgrade L1 Trigger System Layer 1 Calo Trigger oSLB EM candidates Region energies oRM Layer 2 Calo Trigger Calo. Trigger Upgrade in Parallel: Split inputs from ECAL and HCAL Stage HCAL uHTR & assoc. Cal. Trigger Cards HCAL OpticalSplitters • ECAL: optical Serial Link Board (OSLB) and optical Receiver Mezzanines (oRM) connect to Present andUpgrade Calorimeter Trigger • HCAL: optical splitters drive both HTRs and μHTRs US US (Cluster Finding) UK UK (Object Finding) CD-1 Review -- P05: Trigger Upgrade

  12. Upgrade Calorimeter TriggerLayer 1 and 2 Hardware US: (Cluster Finding) UK: Vienna: (Object Finding) CD-1 Review -- P05: Trigger Upgrade

  13. 401.04.04.02: Cal. Trig. ProcessorVirtex-6 Proto. Board – U. Wisconsin • 36 total + 8 spares + 2 test setups = 46 CTP6 JTAG/USB Console Interface Mezzanine Power Modules MMC Circuitry Back End FPGA XC6VHX250T/ XC6VHX380T 4X Avago AFBR-820B Rx Module 12x Multi Gig Backplane Connections 48 optical inputs 12 optical outputs @4.8-6.4 Gbps Front End FPGA XC6VHX250T/ XC6VHX380T Dual SDRAM for dedicated DAQ and TCP/IP buffering Avago AFBR-810B Tx Module CD-1 Review -- P05: Trigger Upgrade

  14. Technical Feasibility • Upgrade is based upon common μTCA hardware platform and components (Virtex-7 FPGA, multi-gigabit optical links) also used by other CMS systems • Many handles to facilitate testing – test-pattern injection, spy-buffer readout as well as test stands • Same team built existing trigger system and wrote its software & firmware → scope, requirements, interfaces well understood • Requirements are frozen in approved Trigger TDR • System is commissioned and operated in parallel with existing trigger • Working prototypes for all major cards exist & have passed tests • Production quotes exist for all critical parts with confirmed delivery times CD-1 Review -- P05: Trigger Upgrade

  15. Value Engineering • Standardize within US CMS Trigger Project • Use of a single FPGA type: Xilinx XC7VX690T • Also used across CMS upgrade and other CERN projects • Negotiated US price at 50% of retail through CERN and US distributor (Avnet) • Standardize across US CMS Upgrade Project • Use of a common crate/backplane infrastructure • Use same μTCAarchitecture as is being used by other CMS subsystems such as HCAL. • Built to similar specifications by common vendors. • Opportunities for pooling spares and cooperation on engineering. • This allows use of common components such as: • Use of standard DAQ/Trigger/Clock Interface: BU AMC13 • Common connection to CMS data acquisition, trigger timing and control systems. • Developed for HCAL project by Boston University CD-1 Review -- P05: Trigger Upgrade

  16. Project Organization CD-1 Review -- P05: Trigger Upgrade

  17. 401.04 Trigger Organization Chart • Muon Port Card & Sorter: • L4 Manager: Paul Padley • Muon Track-Finder:L4 Manager: Ivan Furic • CERN Integration:L4 Manager:Pam Klabbers CD-1 Review -- P05: Trigger Upgrade

  18. Trigger Mgm’t CMS Experience • W.S. (U. Wisconsin) • CMS Trigger Project Manager 1994-2007, • Trigger Coordinator 2007 – 2012 • US CMS L2 Trigger Project Manager 1998 – present • Darin Acosta (U. Florida) • CMS Trigger Project Manager 2012-13 • EMU Track-Finder, US CMS Trigger, 1998- present • Sridhara Dasu (U. Wisconsin) • US CMS L3 Manager for Calorimeter Trigger, 1998 – present • Author of original and upgrade cal. trig. Algorithms 1994 – present • Pam Klabbers (U. Wisconsin) • CMS Regional Calorimeter Trigger Operations Manager(more than a decade on RCT project) • CMS Deputy Trigger Technical Coordinator • Ivan Furic (U. Florida) • CMS CSC muon trigger maintenance and operations 2010-11 • CMS CSCTF Upgrade leader • Paul Padley (Rice U.) • US CMS EMU Project Manager 2006-2012 • EMU Port Card, Clock Card, Sorter, 1998 – present Over 75 years of combined CMS Trigger ManagementExperience! CD-1 Review -- P05: Trigger Upgrade

  19. CMS Trig. Engineering Exp. • Tom Gorski (U. Wisconsin) – Calorimeter Trigger • Over a decade of engineering on the CMS Calorimeter Trigger • Alex Madorsky (U. Florida) – Muon Track-Finder • Over a decade of engineering on CMS Trigger, EMU, CSCTF • Mike Matveev (Rice U.) – Muon Port Cards and Sorter • Over a decade of engineering on CMS Trigger, EMU, Port Cards, Sorter • Mathias Blake (U. Wisconsin) – Cal. Trig. Firmware • New to project • 5 years Applications Engineer at Xilinx, 2 years FPGA Engineer at DRS Technologies, 3 years FPGA Design Engineer at Dolby Labs Over 40 years of engineering experience, 30 on CMS Trigger CD-1 Review -- P05: Trigger Upgrade

  20. ESH&Q CD-1 Review -- P05: Trigger Upgrade

  21. Trigger ESH&Q • Safety: follows procedures in CMS-doc-11587, FESHM • L2 Manager (W.S.) responsible for applying ISM to trigger upgrade. • Under direction of US CMS Project Management. • Modules similar to others built before, of small size and no high voltage • Quality Assurance: follows procedures in CMS-doc-11584 • Regularly evaluate achievement relative to performance requirements and appropriately validate or update performance requirements and expectations to ensure quality. • QA: Equipment inspections and verifications; Software code inspections, verifications, and validations; Design reviews; Baseline change reviews; Work planning; and Self-assessments. • All modules have hardware identifiers which are tracked in a database logging QA data through all phases of construction, installation, operation and repair. • Graded Approach: • Apply appropriate level of analysis, controls, and documentation commensurate with the potential to have an environmental, safety, health, radiological, or quality impact. • Four ESH&Q Risk levels are defined and documented in CMS-doc-11584. CD-1 Review -- P05: Trigger Upgrade

  22. Project Scope CD-1 Review -- P05: Trigger Upgrade

  23. Key Performance Parameters • Threshold: • Demonstration of 98% agreement between the installed upgrade trigger electronics at CERN and software emulation of this electronics through test pattern injection based on data taken after LS1, followed by demonstration of reduction of calorimeter and endcap muon trigger rates for electrons, photons, muons and taus with respect to the present system by a factor of two for a reduction of less than 15% in efficiency using the trigger emulator run on data taken after LS1. Incorporation of unganged ME1/1a data into the endcap muon trigger logic. • Objective: • Demonstration of 99.5%agreement between the installed upgrade trigger electronics at CERN and software emulation of this electronics through test pattern injection based on data taken after LS1 followed by demonstration of reduction of calorimeter and endcap muon trigger rates for electrons, photons, muons and taus with respect to the present system by a factor of two for a reduction of less than 10%in efficiency using the trigger emulator run on data taken after LS1. Calorimeter Trigger electron and photon position resolution improved. Incorporation of unganged ME1/1a data into the endcap muon trigger logic. CD-1 Review -- P05: Trigger Upgrade

  24. External Dependencies • None • Since both muon and calorimeter triggers have full self-test capabilities, both threshold and objective KPP are satisfied w/o requiring connected inputs or outputs. • Trigger electronics can store up sequences of test patterns and inject them into the front end of the trigger electronics at speed • Trigger electronics can receive its output, process and record this at speed for subsequent readout by DAQ. CD-1 Review -- P05: Trigger Upgrade

  25. Schedule CD-1 Review -- P05: Trigger Upgrade

  26. Schedule/Milestones 401.04: 7 L2 Milestones, 8 L3 Milestones, 20 L4 Milestones • Targeting completion of L2 milestones 6 months earlier L2 Milestones: CD-1 Review -- P05: Trigger Upgrade

  27. Schedule – Critical Path • Critical path follows second phase of module production driven by start at CD3 • > 2 years float to project completion CD-1 Review -- P05: Trigger Upgrade

  28. Risk Analysis CD-1 Review -- P05: Trigger Upgrade

  29. 401.04 Trigger Risk Register • 16 risks:15 are threats and 1 opportunity: • https://cms-docdb.cern.ch/cgi-bin/DocDB/ShowDocument?docid=11707 Example risks CD-1 DOE Review -- Risk Management

  30. Overall Trigger Risks & Mitigation • Senior Engineer becomes unavailable (Low Risk) • Hire new engineer, subcontract to consulting firm, use FNAL engineer • Funding is delayed (Low Risk) • Commission with prototypes and/or fewer production boards • Software or Firmware does not meet requirements (Low Risk) • Hire extra expert effort to recover schedule and help personnel • Boards are delayed (design, manufacture or testing) (Low Risk) • Hire extra effort to speed up testing schedule • Vendor non-performance (Low Risk) • Acquire spending authority to use alternative vendors (while original funds are being unencumbered). • Input or output electronics (non-trigger) delayed (Low Risk) • Built in capabilities of trigger electronics provide signals for their own inputs & outputs • Overall Risk Mitigation Strategy: • Continue to provide fully operational current trigger system in parallel with upgrade commissioning • Partial operation of the upgrade systems provide tangible benefits from 2015 onwards CD-1 Review -- P05: Trigger Upgrade

  31. Cost CD-1 Review -- P05: Trigger Upgrade

  32. Quality of Estimate • C&S understood since prototypes for all major cards have been built and have passed tests • Have vendor quotes for all parts • C&S based on experience of the same team that built and wrote software and firmware for existing trigger system • Hardware is based upon common μTCA hardware platform also used by HCAL and other CMS systems • Same team wrote software and firmware for existing trigger system → scope and requirements well understood • Requirements are frozen in approved Trigger TDR • Schedule is robust because it always provides a working trigger at each stage with parallel operation of old and new trigger systems, commissioning and testing of new system during data-taking (with data) and evolution to final system while providing immediate availability of improved trigger in 2015 CD-1 Review -- P05: Trigger Upgrade

  33. Using the Slide Template Base Cost by WBS Base Cost = AY $K (No Contingency) CD-1 Review -- P05: Trigger Upgrade

  34. Using the Slide Template M&S and Labor Base Costs No FNAL Labor in Trigger Project Base Cost & Estimate Uncertainty in AY K$ CD-1 Review -- P05: Trigger Upgrade

  35. Using the Slide Template Labor Resources by Fiscal Year CD-1 Review -- P05: Trigger Upgrade

  36. Using the Slide Template Labor Resources by Type CD-1 Review -- P05: Trigger Upgrade

  37. Using the Slide Template Cost Profile by Fiscal Year Base Cost = AY $K (No Contingency) CD-1 Review -- P05: Trigger Upgrade

  38. Trigger Design Maturity/Contingency Fraction of the cost of the project divided by cost estimate type M&S: 2.4 M$ (48% of total cost) Labor: 2.6 M$ (52% of total cost) CD-1 Review -- P05: Trigger Upgrade

  39. Using the Slide Template Base Cost & Estimate Uncertainty 0 0 No FNAL Labor in Trigger Project Base Cost & Estimate Uncertainty in AY K$ CD-1 Review -- P05: Trigger Upgrade

  40. Summary CD-1 Review -- P05: Trigger Upgrade

  41. Conclusions • Trigger Upgrades meet technical performance requirements • Scope and Specifications of Trigger Upgrade are sufficiently well-defined in TDR and CDR to support the C&S estimates • Risk managed by parallel operation of old and new trigger systems, commissioning and testing of new system during data-taking (with data) • Upgrade based upon common μTCA hardware platform and components used by other CMS systems • ES&H, QA plans, C&S based on experience with working prototypes • Management and Engineering teams are experienced with sufficient design skills, having designed and built original CMS trigger. • Trigger Upgrade not on CMS Project Critical Path • Ready for CD-1 CD-1 Review -- P05: Trigger Upgrade

  42. Additional Slides CD-1 Review -- P05: Trigger Upgrade

  43. L1 Upgrade TDR • Final presentation to LHCC was Tuesday June 11th • Public version of the TDR here:https://cds.cern.ch/record/1556311 • Approved! CD-1 Review -- P05: Trigger Upgrade

  44. Physics Performance Summary(detail in breakout session talks) Average Improvement: 17% (Low Lumi) & 40% (High Lumi) CD-1 Review -- B04-1: Trigger Upgrade Overview

  45. Trigger Staging • CTP7 M&S: no HB/HE Backend until 2016 • Delay purchase of 34 CTP7 cards until FY15 • Use 12 CTP7 Cards w/prototypes as additional spares and for test setups. • EMU CSCTF M&S: one endcap in 2015 and other in 2016 • Commission and test one endcap thoroughly so 2nd can be integrated quickly • Delay spares and use prototypes for spares, test setups • Compatible with Global Muon Trigger using different Endcap inputs • Stages and Content: CD-1 Review -- P05: Trigger Upgrade

  46. Alternatives • Consideration of alternative designs has been performed within constraints of upgrading trigger system in a running experiment and operating both present and upgraded trigger system in parallel to ensure an understood and functional trigger system at any point during data-taking. • Provide incorporation of alternative designs and architectures in design itself so that as physics priorities and beam conditions evolve, algorithms and trigger methodology can evolve as well. • Moving towards providing all available detector information at input of trigger logic so that trigger decision is not impacted by upstream selection of information. • Enables changes in trigger design to have as wide a range of options as possible. CD-1 Review -- P05: Trigger Upgrade

  47. Schedule/Milestones – Level 3 • Targeting completion of milestones 3 months earlier CD-1 Review -- P05: Trigger Upgrade

  48. Schedule/Milestones – Level 4 CD-1 Review -- P05: Trigger Upgrade

  49. Response to Recommendationsfrom Previous Reviews CD-1 Review -- P05: Trigger Upgrade

  50. Response to Recommendationsfrom May Review • Develop a plan prior to the CD-1 review for procurement of components that need to be installed prior to the end of LS1. • Components are Muon Port Card Mezzanines and MPC-EMUTF Optical Fibers that must be installed in collision hall during LS1. • Components moved to the Operations Program budget since are improvements needed when CMS starts up at end of LS1. • Incorporate the missing information identified within comment section into the CDR prior to the CD-1 review. • This has been done and the CDR has been revised CD-1 Review -- P05: Trigger Upgrade

More Related