Hercules: Create A Data Export Job

HGL provides Hercules with a reliable function to share test data with other sites is by exporting the data using the Hercules Media Export mechanism. Hercules provides an interface that allows users to specify the Tests, Configurations, and Manoeuvres that need to be exported and automates the process of restoring the data from tape and then archives it to the media of choice.

Define the Export Media

Click the "Media Export" button. This will open a new page showing the export job list and media. Click on "New Job".

A new window will pop up. Select the option "Create New Medium". Ignore "Add Data To Medium" Then click the next button ">". Note: As of Hercules 3.8.2.0, the function to "Add files to an existing Medium" does not function. Do not try to use it after a media has been created.

On the next page, specify the media details. These fields are:

Location 3 character series that sets the first three letters of the Medium Barcode. Suggestions: "EXP" for Export. "HDD" for Hard Disk Drive.
If this is a normal series to re-use, it will be necessary to remember the last tape number used.
If sending the Medium to a different HGL Site, be sure to select letters that will not match the media series already in use at the remote site.
It is important to not create a media that already exists in the local database or in the remote database.
Medium Type This specifies what type of media that will be used. Only choose a type that the facility can support.
For instance, if you have an AIT-5 tape drive, use that. If the export is to a USB disk drive, choose "Removable Disk"
The Medium Type is represented by the fourth character in the barcode.
Data Set Type Choose "Raw" unless otherwise directed by HGL.
Tape Number Do not choose a number that has been used before or on another machine.
Hercules will prevent users from making media already in its database.
This is represented by the final numbers in the barcode.
Barcode Output string based on the above choices.

Click next, ">" when finished.

The next page, select all the file types. This will make sure that all data attached to the manoeuvres selected for export will be included. Click Next.

Next page shows the Hercules database tree on the left. On the right, the items that will be added to the export media. Users can only specify the Engine, Test, Config, Segment, Recording, or Manoeuvre that will be added to the the media, not the actual files. This is why it is simplest to select all file types for export unless there is reason to choose a subset of data files. Also, it is not possible to mix different file types from different Engines on the same export media. 

To add files to the Expand the tree to the level desired for export, left click on the Test, Configuration, or other level desired for export and drag it to the Export Media side of the window. To remove an item from the media (before creating it), drag the select item to the recycle bin icon. The normal process of making a media will calculate the space needed. This will be reasonably quick for a single segment or a small config. If exporting a large Engine, choose "Fast Mode" to build the export job without calculating the space required. If there is not enough space on the export media (e.g. a small memory stick was used), then Hercules will automatically make a new job and increment the media number to continue the export job on to a second, or third, media. 

Any combination of engines / tests / manoeuvres may be added to the same media.

Click "Create New Medium" when finished.

The media will now appear in the export job table. 

Assigning Media ID

When exporting to a Removable Disk, it is necessary to assign the Media Barcode to the drive. On the drive, a new folder will be created called "HGL_DATA" and it will have a sub folder called "Data Files" and an index file. DO NOT DELETE THESE. These items are created automatically when the barcode is assigned to the drive.

Connect the USB Disk Drive (that does not have an existing "HGL_DATA" directory) into the Hercules. Put a label on the drive with the media name.

Hercules will prompt with the following message:

  • The disk icon will have a dialog coming on top of it (“Drive requires your attention”)

Tape Drive Requires Attention

  • Click on this dialog
    • A window appears listing the possible new media
    • Select the one you want to process
    • Then click the Check Button
    • The job will start and will run until completed.
    • If any files need to be restored from tape, Hercules will prompt to insert any tapes necessary for a restore job. 

 

To check the status of the export, navigate to the Media Export page and the status will list if any files failed to archive. Additional details can found in the "Event Log".

It may be necessary to wait for Hercules to finish restoring any requested files for the Export Job to complete.

Managing the Export Media

If the Export Media is a tape, then be sure to place a barcode label on the tape so the Tape Library can properly locate the tape. Regardless of the media type, it may be sent to another HGL site where it can be loaded into a Hercules and will be detected as a Foreign Media. See Importing Data for details.

If the Export Media is a removable disk, there are a few more options, namely the ability to take the "HGL_DATA" folder and save it to a coporate NAS for remote access. 

All archived HGL Data is encapsulated in the "HGL_DATA" and includes the necessary Index (*.idx) file. The index file and all of the data files need to be kept together for proper operation.

HGL DATA Structure

If the task is to copy the "HGL_DATA" folder to a permanent location, simply attach the Removable Disk Media to the computer system and copy the "HGL_DATA" folder to the secure location. 

Backup To A Secure Location

  1. Copy the "HGL_DATA" folder and its contents to the backup location, such as a NAS. Append the "HGL_DATA" by adding the Media ID to the "HGL_DATA" folder name (e.g. HGL_DATA_HDD100001).
  2. Verify that all the files have been safely copied.
  3. Delete the "HGL_DATA" folder on the Removable Disk media.

Restoring With Removable Disk Media

  1. Attach a new USB Disk Drive to the host computer.
  2. Make sure that there is not an existing "HGL_DATA" folder on the USB Disk Drive.
  3. Copy desired "HGL_DATA" folder to the USB disk.
  4. Rename, or verify, the data folder is only "HGL_DATA" and that it contains the correct index (*.idx) file and "Data Files" folder.
  5. Connect the removable disk to a Hercules HGL System to restore the archived files.

Related Articles