PACE A Partnership for an Advanced Computing Environment

March 30, 2012

New rhel6 shared/hybrid queues are ready!

Filed under: Inchworm deployment — Semir Sarajlic @ 9:20 pm

We are happy to announce the availability of shared/hybrid queues for all sharing rhel6 clusters. Please run “/opt/pace/bin/pace-whoami” to see which of these queues you have access to. We did our best to test and validate these queues, but there could still be some issues left overlooked. Please contact us at if you notice any problems.

Here’s a list of these queues:

  • mathforce-6
  • critcelforce-6
  • apurimacforce-6
  • prometforce-6 (prometheusforce-6 was too long for the scheduler)
  • eceforce-6
  • cygnusforce-6
  • iw-shared-6

Happy computing!


March 28, 2012

Webinar: Parallel Computing with MATLAB on Multicore Desktops and GPUs

Filed under: Events — Semir Sarajlic @ 8:43 pm

Mathworks is offering us a very interesting webinar:

“Parallel Computing with MATLAB on Multicore Desktops and GPUs ”

Friday, March 30, 2012

2:00 PM EDT


In this webinar we introduce how using Parallel Computing Toolbox you can fully leverage the computing power available on your desktop through multicore processors and GPUs.

Through demonstrations you will learn how with minimal changes to your code you can speed up your MATLAB based data analysis, design and simulation work.

The webinar will last approximately 60 minutes. A Q&A session will follow the presentation and demos.

Register here

Mathworks contact:

Jamie Winter


March 27, 2012

Enabling Discovery with Dell HPC Solutions!

Filed under: Events — admin @ 3:16 pm

Dell, along with partners Intel, Mellanox, APC/Schneider Electric and Scientific Computing, would like to invite you to a 1-day workshop to see how HPC Solutions from Dell and Partners can enable cutting edge results in your research labs.


Thursday, April 26, 2012

Emory Conference Center 
1615 Clifton Road
Atlanta, GA  30329

Register Here:


8:30 a.m. – 8:45 a.m.                Registration

8:45a.m. — 9:00 a.m.                Dell Welcome

9:00 a.m. – 9:45 a.m.              “Dell HPC Solutions”  (Dr. Glen Otero, Dell HPC Computer Scientist)

9:45 a.m. – 10:25 a.m.              Suresh Menon, Georgia Institute of Technology

10:25 a.m. – 10:35 a.m.            Break 

10:35 a.m. – 11:15 p.m.            Center for Disease Control Presentation

11:15 p.m. – 11:55  a.m.           Phil Moore, Savannah River National Laboratory

12:00 p.m. – 12:45 p.m.            Networking Lunch

12:45 p.m. – 1:25 p.m.              Boyd Wilson and Randy Martin, Clemson University

1:25 p.m.  —  2:05 p.m.              Neil Bright, PACE, Georgia Institute of Technology

2:05 p.m. –   2:35 p.m.              “The Core to Faster Simulation and Greater Discovery” (Jim Barlow, Enterprise Technologist, Intel)

2:35 p.m. —  2:45 p.m                Break

2:45 p.m. –  3:00 p.m.               Mellanox presentation

3:00 p.m. –  3:15 p.m.              APC presentation

3: 15 p.m. – 4:00 p.m.             “HPC Panel of Experts”  (Ask your HPC questions of this team of HPC Experts from across the industry!)

March 26, 2012

Regarding the job scheduler problems over the weekend

Filed under: tech support — Semir Sarajlic @ 4:24 pm

We experienced a major problem with one of our file servers over the weekend, which caused some of your jobs to fail. We would like to apologize for this inconvenience and provide you with more details on the issue.

In a nutshell, the management blade of our file server we use for scratch space (iw-scratch) crashed for a reason that we are still investigating. This system has a failover mechanism, which allows another blade to take over for continuation of operations. Therefore, you were still able to see your files and could use the software stack that is on this fileserver.

Our node that runs the moab server (job scheduler), on the other hand, mounts this fileserver using another mechanism that uses a static IP. After the new blade took over the operations, our Moab node continued to try mounting the iw-scratch using the IP of the failed blade, needless to say, unsuccessfully.

As a result, some jobs failed with messages similar to “file not found”. This problem also rendered the moab server unresponsive, until we rebooted it Saturday night. Even after the reboot, some problems persisted until we fixed the server this morning. We will keep you updated as we find more about the nature of the problem. We are also in contact with the vendor company to prevent this from happening again.

Thank you once again for your understanding and patience. Please contact us at for any questions and concerns.

March 16, 2012

Funding Opportunity: Major Announcement Expected on Big Data and Other New Developments on Cyberinfrastructure Framework for 21st Century Science and Engineering

Filed under: Events — admin @ 1:31 pm

The National Science Foundation (NSF) continues to develop new activities related to the Cyberinfrastructure Framework for 21st Century Science and Engineering (CIF21)[i] initiative, including:

  • Expected announcement of a major new interagency initiative on challenges related to big data;
  • Release of a new program on Campus Cyberinfrastructure – Network Infrastructure and Engineering (CC-NIE);
  • Release of a new program on Building Community and Capacity for Data-Intensive Research in the Social, Behavioral, and Economic Sciences and in Education and Human Resources (BCC-SBE/EHR); and
  • Release of a new strategic vision and plan for Advanced Computing Infrastructure.

Details of these activities are below.

Major Interagency Initiative Expected on Big Data

The White House is expected to announce on March 29 a major research initiative to solve challenges related to “big data,” or extremely large data sets that are difficult to manage and analyze with today’s software.  NSF, in concert with other agencies, including the National Institutes of Health (NIH), is planning to release a new solicitation on Core Techniques and Technologies for Advancing Big Data Science and Engineering (BIGDATA).  Coordination has reached to the highest levels of the agencies, including meetings between agency leadership at NSF, NIH, and the Department of Energy (DOE).  The solicitation is expected to be modeled after the interagency National Robotics Initiative (, announced in 2011, with various agencies seeking research related to each agency’s specific missions in a single solicitation coordinated by NSF.

According to NSF’s fiscal year (FY) 2013 budget request (, the solicitation will support the development of new tools and approaches to “address the challenges of managing, analyzing, visualizing, and extracting useful knowledge from large, diverse, distributed, and heterogeneous data sets.  This includes the development of data analytics, algorithms, and statistical and mathematical methods.”  The initiative is being developed by the Big Data Senior Steering Group (BDSSG) of the Networking and Information Technology Research and Development (NITRD) program, which coordinates computing research across the government.  BDSSG includes representatives from NSF, NIH, DOE, the Office of Science and Technology Policy (OSTP), National Aeronautics and Space Administration (NASA), National Institute of Standards and Technology (NIST), Department of Defense (DOD), and National Security Agency (NSA).  

Other NSF-Specific Activities:

Campus Cyberinfrastructure – Network Infrastructure and Engineering Program  (CC-NIE)

On March 1, the NSF Office of Cyberinfrastructure (OCI) released a solicitation entitled, “Campus Cyberinfrastructure – Network Infrastructure and Engineering Program (CC-NIE).”  The program will support advancements to networking capabilities at the campus level to connect researchers to national broadband infrastructure and enable scientific data transfer, as well as network integration to allow for stronger performance of scientific applications.

Letters of Intent: Letters of intent are not required.

Due Dates: No preliminary proposals are required.  Full proposals are due May 30, 2012.

Total Funding and Award Size: OCI plans to award a total of $12 million to $15 million in FY 2012.  Data Driven Networking Infrastructure of the Campus and Researcher awards will be supported at up to $500,000 total over up to two years while Network Integration and Applied Innovation awards will be supported at up to $1 million total over up to two years.

Eligibility and Limitations: Only universities and colleges are eligible to apply to this solicitation.  There are no limits on the number of proposals that can be submitted per organization or principal investigator.

Additional Resources: NSF contacts and additional information about CC-NIE are available at


Building Community and Capacity for Data-Intensive Research in the Social, Behavioral, and Economic Sciences and in Education and Human Resources (BCC-SBE/EHR)

On February 22, NSF’s Directorates of Social, Behavioral, and Economic Sciences (SBE) and Education and Human Resources (EHR), along with the Office of Cyberinfrastructure (OCI) announced a new program called Building Community and Capacity for Data-Intensive Research in the Social, Behavioral, and Economic Sciences and in Education and Human Resources (BCC-SBE/EHR).  BCC-SBE/EHR is SBE and EHR’s first involvement in special activities related to CIF21.  The program will support teams to develop visions and prototypes for next generation capabilities and infrastructure for data-intensive science that enables research in SBE and EHR fields.  The issuing of a formal solicitation stands in contrast to the efforts of the Directorate for Geosciences (GEO) to develop data infrastructure, which through its Earth Cube initiative has sought to develop a community-wide vision using a call for white papers and a Charette (community planning session), and is now reviewing EAGER proposals for exploratory prototypes.

Letters of Intent: Letters of intent are not required.

Due Dates: No preliminary proposals are required.  Full proposals are due May 22, 2012.

Total Funding and Award Size: SBE and EHR are planning to award 25 to 60 grants up to a total of $5 million.  Grants may vary in size from workshops to larger than normal standard grants.

Eligibility and Limitations: There are no special eligibility requirements or limits on how many proposals a single institution or principal investigator may submit.

Additional Resources: NSF contacts and additional information about BCC-SBE/EHR are available at


Advanced Computing Infrastructure Vision and Strategic Plan

On February 23, NSF released a document entitled, “Advanced Computing Infrastructure: Vision and Strategic Plan.”  The document is the first of six planned strategic plans for CIF21.  The other plans will focus on learning and workforce development, grand challenge communities, scientific instruments, data, cybersecurity and campus bridging, and software.  The Vision lays out strategic priorities for NSF in developing and supporting a balanced portfolio of advanced computing activities from core enabling research to partnerships and integration with campuses and scientific communities.  Specific strategic directions include:

  • “Foundational research to fully exploit parallelism and concurrency through innovations in computational models and languages, mathematics, statistics, algorithms, compilers, operating and run-time systems, middleware, software tools, application frameworks, virtual machines, and advanced hardware.
  • Research and development in the use of high-end computing resources in partnerships with scientific domains, including new computational, mathematical, and statistical modeling, simulation, visualization, and analytic tools, aggressive domain centric applications development, and deployment of scalable data management systems.
  • Building, testing, and deploying both sustainable and innovative resources into a collaborative ecosystem that encompasses integration/coordination with campus and regional systems, networks, cloud services, and/or data centers in partnerships with scientific domains.
  • Development of comprehensive education and workforce programs, from building deep expertise in computational, mathematical and statistical simulation, modeling, and computational and data-enabled science and engineering (CDS&E) to developing a technical work­force and enabling career paths in science, academia, government, and industry.
  • Development and evaluation of transformational and grand challenge community programs that support contemporary complex problem solving by engaging a comprehensive and integrated approach to science, uti­lizing high-end computing, data, networking, facilities, software, and multidisciplinary expertise across com­munities, other government agencies, and international partnerships.”

The full plan, including more detail on each strategic direction, can be found at

[i] CIF21, first proposed in the fiscal year (FY) 2012 NSF budget request, is an agency-wide effort to develop comprehensive, integrated, sustainable, and secure cyberinfrastructure to accelerate research and education capabilities in computational and data-enabled science and engineering.  The initiative encompasses four components: Data-enabled Science, Community Research Networks, New Computational Infrastructure, and Access and Connections to Cyberinfrastructure Facilities.  The CIF21 initiative is largely influenced by six taskforces of the Advisory Committee on Cyberinfrastructure (ACCI), which were set up in 2009 to investigate long-term challenges related to cyberinfrastructure and issued final reports in April 2011 (  CIF21 encompasses both agency-wide programs and more targeted investments.

New details about XSEDE12 Conference

Filed under: Events — admin @ 1:01 pm

XSEDE seeks high-quality papers on science, education, outreach, training

A new conference from XSEDE is coming! This conference will support and enhance the world of advanced digital resources and services. Scientists, engineers, social scientists, and humanities experts at colleges, universities, and research centers around the world use those resources and services to make us all healthier, safer and better informed.

XSEDE, the eXtreme Science and Engineering Discovery Environment, is the largest collection of distributed cyberinfrastructure for open scientific research in the United States. As the inaugural conference of XSEDE, XSEDE12 is a forum for the presentation of high-quality technical papers, posters, panels, and Birds of a Feather sessions that will facilitate communication among scientists and students who use XSEDE and other cyberinfrastructure resources. We are particularly interested in submissions related to:

  • XSEDE, science results from XSEDE, EOT (education, outreach, training) activities that make use of XSEDE, and technology developments that make XSEDE work!
  • Other cyberinfrastructure systems – within or outside the United States
  • Campus bridging – technologies that help researchers, educators, and students integrate local campus cyberinfrastructure resources, regional, national, and international resources. (XSEDE has international partners, and we are very interested in cyberinfrastructure papers from outside the United States.)

XSEDE is one component — the largest single component to date — in the implementation of the National Science Foundation’s CyberInfrastructure Framework for 21st Century Science and Engineering. Thus, any submission related to NSF’s CIF21 is invited, particularly papers that have implications for interaction and interoperability among other cyberinfrastructure projects and XSEDE.

Key dates related to XSEDE12 include:

  • April 13: Tutorial and Panel proposals due.
  • April 25: Paper submissions due, including student research papers.
    Student papers will be presented as an integrated part of the conference program.
  • May 14: Conference registration opens.
  • May 15: Visualization Showcase abstracts and BOF proposals dues.
  • May 30: Poster submissions due.

XSEDE12 registration costs:

  • Conference registration, general attendees:
    • $450 early registration, $525 late registration
    • Student registration: $375
  • Tutorial registration:
    • Registered conference participants: $75
    • Student attendees: $25
    • Tutorial-only registration: $125 for full day, $100 for 1/2 day

This promises to be an excellent conference. The organizing committee hopes you will take part by attending and presenting papers or posters. The first step is submitting that manuscript!

For details, please see the XSEDE12 Call For Participation at: 

March 2, 2012

upcoming DOE-INCITE call for proposals

Filed under: Events — admin @ 2:34 pm

The ORAU University Partnerships Office is pleased to provide the information below regarding a program available to all institutions. This notice is a service to ORAU Sponsoring and Associate Institutions. Please forward within your institution and broadly to colleagues as you feel appropriate.

Dear Colleagues:

The U.S. Department of Energy’s Office of Science provides a portfolio of national high-performance computing facilities housing some of the world’s most advanced supercomputers. These leadership computing facilities enable world-class research for significant advances in science. Open to researchers from academia, government labs, and industry, the Innovative and Novel Computational Impact on Theory and Experiment (INCITE) Program is the major means by which the scientific community gains access to some of the fastest supercomputers. The program aims to accelerate scientific discoveries and technological innovations by awarding, on a competitive basis, time on supercomputers to researchers with large-scale, computationally intensive projects that address “grand challenges” in science and engineering.

The 2013 INCITE Call for Proposals opens April 11, 2012 and closes June 27, 2012. To help you prepare an INCITE proposal or to learn more about the program, two INCITE Proposal Writing Webinars will be offered on March 26, 2012 at 10:00 a.m. EDT, and on April 24, 2012 at 2:00 p.m. EDT. The 1.5 hour webinars will also include discussion on the Director’s Discretionary Program, a way to request early access to port, tune, and scale your codes in preparation for an INCITE application. The 2013 INCITE Call for Proposals is for awards of compute time on the Cray XK6 (Titan) system at the Oak Ridge Leadership Computing Facility and the IBM Blue Gene/P (Intrepid) and IBM Blue Gene/Q (Mira) systems at the Argonne Leadership Computing Facility.
For more details and early registration for these events, see for the March 26th event and for the April 24th event. For more information on the INCITE Program web site, see Specific questions should be addressed to the INCITE Program Manager, Julia White, at

University Partnerships Office
Dr. Arlene Garrison – 865.241.1513(o), 865-599-3311(c)
Cathy Fore – 865.241.8158
Ann Farler – 865.576.1898
Dr. Steve Roberts – 865.576.6513 

Oak Ridge Associated Universities (ORAU),, is a university consortium leveraging the scientific strength of 102 major research institutions to advance science and education by partnering with national laboratories, government agencies, and private industry. ORAU manages the Oak Ridge Institute for Science and Education for the U.S. Department of Energy.

Powered by WordPress