Shaping Collaboration 2006: Dec. 11 - 13, 2006

1

Fermilab

LHC at CERN - Geneva, Switzerland

Fermilab

- Batavia, Illinois

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

2

Overview

•

Remote operations for CMS & LHC

•

What is LHC@FNAL?

•

Planning

•

Status

•

Needs

•

//cd-amr

.

fnal

.html

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

3

1.

Build a dedicated remote operations center to

support both CMS and

LHC

commissioning and operations.

Remote shifts for CMS

Enable CMS and LHC experts to access information in real time

Participate remotely in studies, commissioning, and operations

Training

 

for CMS & LARP (LHC Accelerator Research Program)

2.

Facilitate communication with CMS and LHC control rooms.

Call center

 

in the US - to help contact experts, answer questions.

T

est collaboration tools to improve communication

3.

Take advantage of a unique opportunity to have detector and accelerator

experts working together to solve problems.

4.

The

principal goal

is to enable people to participate in commissioning &

operations when they are unable to

 

travel (cost, family, visa issues, etc.).

Goals for

Joint CMS & LHC Remote Operations

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

4

Remote Operations for US-CMS

The remote operations center will serve the US-CMS community.

There are nearly 50 US institutions

in CMS and approximately 600 signing

physicists/engineers/guest scientists in

the US.

The LHC Physics Center (LPC) will provide

a place in the US for physics/analysis

discussions and meetings.

The

 

LHC@FNAL remote operations center

will provide a US hub for operations

activities.

The goal is to provide a facility

 

that will

enable CMS collaborators to take remote

shifts (for example, data-quality monitoring)

C

M

S

 

H

e

a

d

 

C

o

u

n

t

,

 

P

h

.

D

 

P

h

y

s

i

c

i

s

t

s

,

 

4

3

8

 

T

o

t

a

l

Boston Univ., Boston

Brown Univ., Providence

UC Davis, Davis

UCLA, Los Angeles

UC Riverside, Riverside

UC San Diego, La Jolla

UC Santa Barbara, Santa Barbara

California Inst. of Tech., Pasadena

Carnegie Mellon Univ., Pittsburgh

University of Colorado at Boulder, Boulder

Cornell University, Ithaca

Fairfield Univ., Fairfield

Fermi National Accelerator Lab., Batavia

Univ. of Florida, Gainesville

Florida International University, Miami

Florida State Univ., Tallahassee

Florida Inst. of Tech., Melbourne

Univ. of Illinois at Chicago, Chicago

The Univ. of Iowa, Iowa City

Iowa State Univ., Ames

Johns Hopkins Univ., Baltimore

The Univ. Of Kansas, Lawrence

Kansas State Univ., Manhattan

LLNL, Livermore

Univ. of Maryland, College Park

Mayaguez, Puerto Rico

Massachusetts Inst. of Tech., Cambridge

Univ. of Minnesota, Minneapolis

U

Fermilab

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

5

Remote operations for LHC

CCC

Remote operations center for LHC:

•

provide

training before going to CERN

•

support LHC components built in US

•

 

participate remotely in LHC studies

•

access monitoring information

•

 

develop

 

software for LHC

CCC at CERN

LARP:

The US LHC Accelerator Research

Program (LARP) consists of four US

laboratories, BNL, FNAL, LBNL and SLAC, who

collaborate with CERN on the Large Hadron

Collider (LHC).

The LARP program enables U.S. accelerator

specialists to take an active role in the LHC

accelerator during its commissioning and

operations, and to be a major collaborator in

LHC performance upgrades.

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

6

What is LHC@FNAL?

•

A Place

•

That provides access to information in a manner that is similar to

what is available in control rooms at CERN

•

Where members of the LHC community can participate remotely in

LHC and CMS activities

•

A Communications Conduit

•

Between CERN and members of the LHC community located in

North America

•

An Outreach tool

•

Visitors will be able to see current LHC activities

•

Visitors will be able to see how future international projects in particle

physics (such as the ILC) can benefit from active participation in

projects at remote locations.

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

7

LHC@FNAL Location & Layout

Conference

(Phase 1)

      

LHC@FNAL is located in

 

Fermilab

’

s

Wilson Hall (1

st

floor)

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

8

LHC@FNAL Construction

 

Status

Construction is almost complete (photo taken Nov. 30, 2006).

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

9

•

We formed a task force with members from all

F

ermilab

 

divisions, university groups,

CMS, LARP, and LHC. The advisory board had an even broader base.

•

The LHC@FNAL task force developed a plan with input from many sources including

CMS, LHC, CDF, D0, MINOS, MiniBoone and Fusion Energy Sciences (FES).

•

We worked with CMS and US-CMS management, as well as members of LARP and the

LHC machine group at all steps in the process.

•

A detailed requirements document for LHC@FNAL was prepared and reviewed in 2005.

•

We visited 9 sites (e.g. Hubble, NIF, ESOC) to find out how other projects build control

rooms and do remote operations.

•

We have

 

a Collaboration Agreement between CERN and FNAL to work on LHC software

development.

•

We are engaged in construction, integration, software development and outreach activities.

The CMS Remote Operations Center (ROC) is already in operation.

•

The goal is to have LHC@FNAL ready for detector commissioning and startup of beam in

2007.

•

We plan to work with the ILC controls group to develop plans for ILC remote operations.

•

We

 

hope to collaborate with

 

the

 

Fusion

community (FES) to develop collaborative tools.

Together we are exploring connections to OSG

 

and other GRID projects.

Planning for LHC@FNAL

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

10

Current Status of LHC@FNAL

•

Construction of a joint CMS and LHC remote operations center

(LHC@FNAL) is nearing completion - Spring 2007

•

LHC@FNAL Software (LAFS) development effort for LHC

accelerator software has been successfully launched. This

is a collaboration between CERN and

Fermilab

.

•

Software development for LHC, CMS, ILC:

1.

Role Based Access for LHC (RBA)

2.

LHC Sequencer

3.

Sequenced Data Acquisition (SDA)

4.

Screen Snapshot Service (SSS)

5.

Identity Database (IDDB)

6.

LHC Beam Instrumentation Software

7.

Electronic Logbook for ILC

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

11

An approach to restrict system access to authorized users

What is a

ROLE

?

•

A role is a job function within an organization.

•

Examples: LHC Operator, SPS Operator, RF Expert, PC Expert, Developer,

…

•

A role is a set of access permissions for a device class/property group

•

Roles are defined by the security policy

•

What is being

 

ACCESSED

?

•

Physical devices (power converters, collimators, quadrupoles, etc.)

•

What type of

 

ACCESS

?

•

Read: the value of a device once

•

Monitor: the device continuously

•

Requirements have been written

•

Authentication

•

Status:

collaboration working on RBA for the LHC control system.

Role Based Access (RBA)

crucial

monitor a device safely

.

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

12

What is a snapshot?

•

An image copy of a graphical user interface at a particular instance in time.

•

Examples: DAQ system buffer display, operator control program,

…

•

A view-only image, so there is no danger of accidental user input.

•

What is the role of the service

?

•

Receives and tracks the snapshots from the monitored applications.

•

Caches the snapshots for short periods of time.

•

Serves the snapshots to requesting applications/users.

•

Prevents access from unauthorized applications/users.

•

How will this work?

•

Applications capture and send snapshots to the service provider in the background.

•

Status:

•

The capturing of snapshots from Java applications has been demonstrated.

•

The transfer of snapshots

 

is

 

for CMS, and

may be applicable to the LHC.

Screen Snapshot Service (SSS)

Monitored

Application(s)

Snapshot

Service

Web

requests

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

13

Future Capabilities for HEP

Although we are making good progress on the development of remote operations

capabilities for high-energy physics (HEP), there is

room for improvement

.

 

Better

collaborative tools

 

will contribute significantly to our ability to participate in LHC,

and plan for

 

the International Linear

Collider

(ILC).

We can benefit from improved

communications tools

by

•

exploiting convergence of

 

telecom and internet technologies (e.g. SIP),

•

deploying integrated communications (voice, video, messaging, email, data)

•

and advanced directory services for identification, location and scheduling.

We can benefit from a

 

true

collaborative control room

by

•

 

deploying distributed, shared

 

display walls for remote collaborative visualization.

We can benefit from security enhancements (role-aware & easier-to-use security).

Some of these needs are already being addressed by Fusion (FES) community.

---

Presentation to OHEP, OFES, OASCR: Nov 7, 2006

14

Approaches to OASCR

Fusion Energy Sciences

High Energy Physics

New

FusionGrid

  

Computational

  

Services

MDSplus

Collaborative Displays

Federated Security

Role Based Access

Sequenced Data Acquisition (SDA)

SIP Communication Tools

LHC Sequencer

LHC Beam

Instrumentation

Identity Database (IDDB)

Electronic

Logbook

Screen Snapshot Service (SSS)

FusionGrid

Parallel

  

Computational

  

Services

   

Substantial Overlap Between FES and HEP Needs

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

15

Summary

•

 

The goals of LHC@FNAL are to support both CMS and LHC

commissioning and operations, and to take advantage of an

opportunity to have detector and accelerator experts work together.

•

The LHC@FNAL remote operations center is under construction,

and will be completed by

 

Spring 2007.

•

A collaborative effort between CERN and

Fermilab

to develop LHC

accelerator software has been successfully launched.

•

There is an urgent need for better collaborative tools to improve our

ability to work on the LHC.

•

There is substantial overlap between the needs for High Energy

Physics (HEP) and Fusion Energy Sciences (FES) for collaborative

tools.

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

16

Additional Slides

---

Shaping Collaboration 2006: Dec. 11 - 13, 2006

17

Site Visits

•

–

West Chicago, Illinois

(Aug. 25, 2005)

•

–

Hilo, Hawaii

(Sept. 20, 2005)

•