Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

(warning) External links on this page can only be accessed from outside the RE (warning)

November 2020: Research Environment and HPC outage

  • The Research Environment will be unavailable to perform some essential maintenance 18:00 Friday 13th November – 18:00 Sunday 15th November.
  • The HPC (Helix) will be unavailable one day earlier from 18:00 Thursday 12th November to 18:00 Sunday 15th November.
  • We will be carrying out the HPC work on Sunday 15th, but we are pausing access to the HPC three days in advance to allow jobs to complete prior to the work. If you try to submit a job to the HPC during the outage, the job will be held and will then be executed once the maintenance is finished. 

April-June 2020: User migration to the new HPC Helix

For information on the migration of your account to the new HPC called Helix, please visit the following page: HPC (Helix) Migration 2020. We will be updating our User Guide accordingly.

March-May 2020: Genome migration

We have recently initiated the process to migrate of all genomes in the Research Environment to a new storage system. The migration is expected to last approximately two months. Each genome will be temporarily unavailable when it is migrated. This means that, in practice, any HPC jobs trying to access a genome at the time of its migration will fail. In most cases, as each genome will only be unavailable for a couple of minutes, restarting your job will resolve the issue. However, jobs trying to access multiple genomes will be more severely affected. While this will cause some disruption over the next two months, once the migration is completed, the high-performance compute cluster will run significantly faster.

It is therefore recommended that you consider adding extra file-checking steps to your code so that it fails gracefully if a file is unavailable. If your code is looping over many genome files, you might consider modifying it such that it is able to skip any files that appear to be unavailable, while keeping track of them so that they can be tried again later.

5th August 2019: Duplicate rows in the cancer_analysis table

There are seven completely duplicated rows in the cancer_analysis table. The interpretation request IDs for these duplicated rows are: 15807-1, 21450-1, 22977-1, 14581-2, 30736-1, 31083-1, 42295-1. Please ensure these are considered in any analysis.

5th August 2019: Participant with incorrect gender in the cancer_analysis table

A participant has been identified with incorrect gender assignment in the cancer_analysis table. The participant has two interpretation request IDs for two different tumour-normal pairings. The IDs are: 14497-1 and 48870-1. As a rule of thumb, please use the latest interpretation request ID (48870-1) in all cases for the correct gender assignment. 

31st July 2019: LabKey API

The Rlabkey R package for querying LabKey contains a bug whereby only the first 100,000 rows of a table are imported when using the labkey.selectRows() function (even when the maxRows argument is set to > 100,000). 

To work around this issue, please use the labkey.executeSql() function instead. For example, to select the entire sequencing_report table for the Main Programme V7 release, use the following code:

Code Block
languagepy
themeEclipse
titlelabkey.executeSql
linenumberstrue
library(Rlabkey)
labkey.setDefaults(baseUrl = "http://emb-prod-mre-labkey-01.gel.zone:8080/labkey")

sequencing_report <- labkey.executeSql(
    folderPath = "/main-programme/main-programme_v7_2019-07-25",
    schemaName = "lists",
    colNameOpt = "rname", 
    maxRows = 10000000,
    sql = "SELECT * FROM sequencing_report")

Please see: Using the LabKey API for more SQL examples. 

4th April 2019: IGV Genome Browser

The Broad Institute have changed where they host the genome files for IGV (from igvdata.broadinstitute.org/* to https://s3.amazonaws.com/igvdata.broadinstitute.org/*). As the latter is not yet 'white-listed' within the Research Environment, the genome files will not be accessible causing an error to occur when attempting to load them within IGV. 

We have manually downloaded the FASTA, RefSeq annotation, chromosome cytoband, and chromosome aliases from the Broad for hg19/GRCh37 and hg38/GRCh38 reference assemblies and have created .genome files from them. These are identical to the default ones present in IGV and can be loaded into IGV using the instructions below.

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

You can view all live service issues on the Genomics England Status Page. We recommend that you subscribe to receive email alerts by following the steps below.

  1. Follow this link to the Status Page: https://genomicsengland.statuspage.io

  2. Click the ‘SUBSCRIBE TO UPDATES’ button and input your email address.
    Image Added
  3. Confirm your subscription by following the link sent to your email address.

  4. Select relevant system notifications. We recommend that you click "Select none" to deselect all and then opt in to all notifications under "Research_Environment" as well as "GE_Jira_Service_Desk".
    Image Added

  5. Optional: You can also get alerts via text message. To activate those, you will need to click on the text notifications button and follow the same process.


Managing your subscriptions

To change what alerts you are receiving, click the ‘SUBSCRIBE TO UPDATES’ button, enter your email (or phone number is you want to amend the text alerts) and the system will display what items you are registered for.  You can tick/untick components as required.

If you have any issues, please contact the GeL ServiceDesk: