Maintenance is provided at the discretion of the astronomer responsible for the utility. All are available without warranty.

Maintenance is provided at the discretion of the astronomer responsible for the utility. All are available without warranty.

These modules have been developed for astronomers by astronomers. Maintenance is provided at the discretion of the astronomer responsible for the utility. All are available without warranty.

These modules have been developed for astronomers by astronomers. Maintenance is provided at the discretion of the astronomer responsible for the utility. All are available without warranty.

GlenLangston - 02 Sep 2005

GlenLangston - 14 Dec 2006

%META:FILEATTACHMENT{name="findTau.pdf" attr="" comment="findTau user's guide " date="1166125771" path="findTau.pdf" size="97694" user="GlenLangston" version="1.1"}%

For some data analysis products, there are also recipes available which show how to go through a data reduction case in the environment of a particular tool. (See recipes in GBT IDL as an example - product is under development.)

For some data analysis products, there are also recipes available which show how to go through a data reduction case in the environment of a particular tool. (See recipes in GBT IDL as an example.)

GlenLangston - 02 Sep 2005

Welcome to the home of GB.Data. This is a web-based collaboration area designed to facilitate communication, planning, execution and documentation of all tasks related to producing, reducing and analyzing single dish data. Progress on all data related projects will be made with respect to the current and planned GbtCapabilities?.

Welcome to the home of GB.Data. This is a web-based collaboration area designed to facilitate communication, planning, execution and documentation of all tasks related to producing, reducing and analyzing single dish data. Progress on all data related projects will be made with respect to the current and planned GBT Capabilities.

TOC: No TOC in "Data.WebHome"

Standard Observing Modes; Data Reduction Cases

The GBT currently supports 14 Standard ObservingModes. For several of the Standard ObservingModes, there are data reduction cases available which describe how data analysis would be approached for each case:

• HowToReduceBSData
• HowToReduceContinuumOTFData
• HowToReduceFSTrackData
• HowToReduceFocusData
• HowToReduceGridMapData
• HowToReduceMultiIFData
• HowToReduceOTFData
• HowToReducePSwitchDoubleBeamData
• HowToReducePSwitchSingleBeamData
• HowToReducePointingData
• HowToReduceTPTrackData
• HowToReduceTipData

For some data analysis products, there are also recipes available which show how to go through a data reduction case in the environment of a particular tool. (See recipes in GBT IDL as an example - product is under development.)

Several data analysis packages are in use at Green Bank. AIPS, AIPS++, CLASS, and IDL are available for public use. Limited observer support is available for all of the above except CLASS.

Several data analysis packages are in use at Green Bank. All of the official user's manuals can be found at DocumentationAndHelp.

Independently Developed Utilities

These modules have been developed for astronomers by astronomers. Maintenance is provided at the discretion of the astronomer responsible for the utility. All are available without warranty.

• DocumentationAndHelp - review all user's manuals here
• AIPS - ClassicAIPSGuide
• AIPS++
  1. DishHome is the place to get started with Dish, the GBT spectral line data reduction package
  2. Dish User's Guide for the GBT
  3. Guide to using IARDS
  4. Optimizing aips++ for use in Green Bank
• CLASS - UsingClass
• IDL - UsingIDL, rt_idl (IDL temporary test environment)
• Matlab - UsingMatlab, GbtMatlabScripts
• Mathematica - GBT Pulsar Audio Notebooks
• A PythonFramework is used for all new prototype development
• Independently Developed Utilities - These modules have been developed for astronomers by astronomers. Maintenance is provided at the discretion of the astronomer responsible for the utility. All are available without warranty.
  • validator - Validate a current or past GBT observation and produce an ascii summary of the observation
  • tableToTxt - Convert most GBT output FITS data tables to Ascii for editting
  • txtToTable - Convert an Ascii version of a FITS table back to a valid FITS file.
  • ott - compute the Ott et al. flux densities for calibration sources
  • archiveFind - Find past GBT observations with selected parameters (ie source, observer, backend etc)

Active Beta Products & Other News

• (1/9) - DISH User's Documentation at DishUsersGuideForGBT
• (12/18/03) - Real Time and Offline Data Display (details at GbtFitsMonitor)
• (11/18/03) - Configuration API (details at ConfigurationAPI)

Project Work Packages and Associated Resources

• IDL - UsingIDL

• IDL - UsingIDL, rt_idl (IDL temporary test environment)

• Mathematica - stay tuned

• Mathematica - GBT Pulsar Audio Notebooks

• Matlab - UsingMatlab

• Matlab - UsingMatlab, GbtMatlabScripts

• (12/18/03) - Real Time and Offline Data Display (details at GfmBeta?)

• (12/18/03) - Real Time and Offline Data Display (details at GbtFitsMonitor)

• (11/24/03) - SDFITS Generation (details at SdfitsBeta)

• SDFITS generator - beta version

• SDFITS generator - official release

1. 1. DishUsersGuideForGBT
   2. IardsGuide
   3. OptimizingAIPSppInGB
   4. ItemsForMaintenance - JimsBugsToBeAssessed, BobsBugsToBeAssessed

1. 1. Dish User's Guide for the GBT
   2. Guide to using IARDS
   3. Optimizing aips++ for use in Green Bank

1. 1. DishHome is the place to get started with Dish, the GBT spectral line data reduction package

• (11/18/03) - Configuration API (details at HowToConfigureTheGbt?)

• (11/18/03) - Configuration API (details at ConfigurationAPI)

• Configuration API? and ConfigurationCases with complete example scripts

• Configuration API and ConfigurationCases with complete example scripts

• Astrid? - Integrated Desktop

• Astrid - Integrated Desktop

• (12/18/03) - Real Time and Offline Data Display (details at RtfmBeta?)

• (12/18/03) - Real Time and Offline Data Display (details at GfmBeta?)

What's New

Active Beta Products & Other News

• (1/9) - DISH User's Documentation at DishUsersGuideForGBT
• (12/18/03) - Real Time and Offline Data Display (details at RtfmBeta?)
• (11/24/03) - SDFITS Generation (details at SdfitsBeta)
• (11/18/03) - Configuration API (details at HowToConfigureTheGbt?)

• (11/24) SdfitsBeta Release - astronomers, please review and comment at SdfitsBetaComments?
• (10/9) Toney's latest Observing Keywords
• (10/9) Ron and I have started meeting to put together a GBT data analysis roadmap/strategy. Our notes are at RoadmapWorksheet. Please add to them so we can converge on an approach that meets everyone's needs. One of the first steps will be to organize sessions to brainstorm on several of these topics. Import/Export has already been discussed extensively, and Quality to a lesser extent.
• (9/24) What's going on with GBT Data? Many people have been asking this question lately. The answers will be provided in a poster at the upcoming ADASS conference, which is currently undergoing review. A preliminary draft is viewable at AdassData - if you are interested, and can provide constructive comments, we invite you to do so.

Project Work Packages and Associated Resources

• Independently Developed Utilities - These modules have been developed for astronomers by astronomers. Maintenance is provided at the discretion of the astronomer responsible for the utility. All are available without warranty.

Current Efforts

Data Handling Project

Data Quality Work Package

1. UnifiedFITSDevelopmentPlan
2. DataQuality

Data Export & Accessibility Work Package

1. Project Charter 12/11/02
2. FitsQueryLanguage was developed in early 2003 to make it easier to extract data from one or more FITS files
3. A summer exploration of Data Accessibility to IDL was conducted
4. An intermediary data format was chosen based on SDFITS - Review its history within NRAO?
5. Work is being done during C7 and C8 2003 to create a UnifiedFITS representation of GBT data
6. Early Results at AdassData

Data Preprocessing Work Package - details

1. Bob Garwood's Gap Analysis of Python preprocessing components
2. The 11/21/01 draft Calibration Memo is available

Data Display Work Package - details to be added

Imaging Work Package - not started

Ease of Use Initiative

When it's time to go public, we will have to make sure all of the following Setup Documentation is updated, put on the wiki, and old versions removed. There is a lot of great information that we need to "modernize" when the time is right.

Configure Work Package

1. Status of test cases - to be added 9/30
2. Details at GbtConfiguration
3. Review the Scope of the Work
4. This utility uses the SOAP GbtInterface to communicate with the M&C system
5. Based on work during Fall 2002 on the ConfigurationTool? and Spring 2003 on ConfigGui

Observe/Status Work Packages

1. GB systems ease of use will be enabled by the IntegratedDesktop? concept
2. Test cases for the new python GO procedures: ObservingProcTestCases

Metrics Work Package

• This is a new idea as of 10/1. Basically, we need to keep track of how much simpler the system is getting as we release Ease of Use developments. How to do this:

1. Determine the optimal number of steps for a particular science use case
2. Determine time it takes to execute those steps
3. Determine the actual number of steps, and time it takes on average to go through them, for each science case
4. Keep a time series of how the actual number of steps, and elapsed time to complete them, decreases towards the level that was declared optimal.

1. Test cases for the new python GO procedures: ObservingProcTestCases

1. Test cases for the new python GO procedures: ObservingProcTestCases

• (11/24) SdfitsBeta Release - astronomers, please review and comment at SdfitsBetaComments?

1. Work is being done during C7 and C8 2003 to create a UnifiedFITS representation of GBT data

1. Work is being done during C7 and C8 2003 to create a UnifiedFITS representation of GBT data

1. Test cases for the new python GO procedures: ObservingProcTestCases

• spectrometer - Real-time Plot current of Current GBT observations. Produces Web page output.

• ott - compute the Ott et al. flux densities for calibration sources
• archiveFind - Find past GBT observations with selected parameters (ie source, observer, backend etc)

• validator - Validate a current or past GBT observation and produce an ascii summary of the observation
• tableToTxt - Convert most GBT output FITS data tables to Ascii for editting
• txtToTable - Convert an Ascii version of a FITS table back to a valid FITS file.
• spectrometer - Real-time Plot current of Current GBT observations. Produces Web page output.

• (10/9) Toney's latest Observing Keywords
• (10/9) Ron and I have started meeting to put together a GBT data analysis roadmap/strategy. Our notes are at RoadmapWorksheet. Please add to them so we can converge on an approach that meets everyone's needs. One of the first steps will be to organize sessions to brainstorm on several of these topics. Import/Export has already been discussed extensively, and Quality to a lesser extent.

1. 1. Items for Maintenance - JimsBugsToBeAssessed, BobsBugsToBeAssessed

1. 1. ItemsForMaintenance - JimsBugsToBeAssessed, BobsBugsToBeAssessed

When it's time to go public, we will have to make sure all of the following Setup Documentation is updated, put on the wiki, and old versions removed. There is a lot of great information that we need to "modernize" when the time is right.

Metrics Work Package

• This is a new idea as of 10/1. Basically, we need to keep track of how much simpler the system is getting as we release Ease of Use developments. How to do this:

1. Determine the optimal number of steps for a particular science use case
2. Determine time it takes to execute those steps
3. Determine the actual number of steps, and time it takes on average to go through them, for each science case
4. Keep a time series of how the actual number of steps, and elapsed time to complete them, decreases towards the level that was declared optimal.

Observe/Status Work Packages

1. GB systems ease of use will be enabled by the IntegratedDesktop? concept

Welcome to the home of GB.Data. This is a web-based collaboration area designed to facilitate communication, planning, execution and documentation of all tasks related to producing, reducing and analyzing single dish data.

Welcome to the home of GB.Data. This is a web-based collaboration area designed to facilitate communication, planning, execution and documentation of all tasks related to producing, reducing and analyzing single dish data. Progress on all data related projects will be made with respect to the current and planned GbtCapabilities?.

Other Data Analysis Topics

What's New

• (9/24) What's going on with GBT Data? Many people have been asking this question lately. The answers will be provided in a poster at the upcoming ADASS conference, which is currently undergoing review. A preliminary draft is viewable at AdassData - if you are interested, and can provide constructive comments, we invite you to do so.

Data Analysis Root Cause & Improvements Project

1. CapabilityGrid?
2. DataImportExport?
3. DataSchema?
4. DataStructureAndManipulation?
5. ConfigurationAndObservation?
6. CalibrationAlgorithms?
7. DataDisplay?
8. AnalysisProcedures
9. ImagingTools
10. DocumentationAndHelp
11. SoftwareMarketing?
12. CustomerSatisfactionPlan?
13. RegressionTests?

Data Reduction

1. UnifiedFITS

Data Analysis Packages

Several data analysis packages are in use at Green Bank. AIPS, AIPS++, CLASS, and IDL are available for public use. Limited observer support is available for all of the above except CLASS.

• DocumentationAndHelp - review all user's manuals here
• AIPS - ClassicAIPSGuide
• AIPS++
  1. DishUsersGuideForGBT
  2. IardsGuide
  3. OptimizingAIPSppInGB
  4. Items for Maintenance - JimsBugsToBeAssessed, BobsBugsToBeAssessed
• CLASS - UsingClass
• IDL - UsingIDL
• Matlab - UsingMatlab
• Mathematica - stay tuned
• A PythonFramework is used for all new prototype development

Current Efforts

Data Handling Project

Data Quality Work Package

1. UnifiedFITSDevelopmentPlan
2. DataQuality

Data Export & Accessibility Work Package

1. Project Charter 12/11/02
2. FitsQueryLanguage was developed in early 2003 to make it easier to extract data from one or more FITS files
3. A summer exploration of Data Accessibility to IDL was conducted
4. An intermediary data format was chosen based on SDFITS - Review its history within NRAO?
5. Work is being done during C7 and C8 2003 to create a UnifiedFITS representation of GBT data
6. Early Results at AdassData

Data Preprocessing Work Package - details

1. Bob Garwood's Gap Analysis of Python preprocessing components
2. The 11/21/01 draft Calibration Memo is available

Data Display Work Package - details to be added

Imaging Work Package - not started

Ease of Use Initiative

Configure Work Package

1. Status of test cases - to be added 9/30
2. Details at GbtConfiguration
3. Review the Scope of the Work
4. This utility uses the SOAP GbtInterface to communicate with the M&C system
5. Based on work during Fall 2002 on the ConfigurationTool? and Spring 2003 on ConfigGui

1. SingleDishFITS?

1. UnifiedFITS

How-To Data Analysis Topics

Data Reduction

1. SingleDishFITS?

1. RegressionTests?

Current Data Analysis Topics

How-To Data Analysis Topics

1. IardsGuide
2. DishUsersGuideForGBT
3. OptimizingAIPSppInGB AIPSpp = AIPS++
4. ClassGuide?
5. ClassicAIPSGuide

Other Data Analysis Topics

Future Data Analysis Topics

Data Analysis Root Cause & Improvements Project

1. CapabilityGrid?

Functionality Surveys

Site Tools of the Data Web

1. IardsGuide

1. OptimizingAIPSppInGB AIPSpp = AIPS++
2. ClassGuide?
3. ClassicAIPSGuide

Data Analysis Topics

Current Data Analysis Topics

1. DishUsersGuideForGBT

Future Data Analysis Topics

Data Analysis Topics

Functionality Surveys

• MeetingMinutes?

1. DataImportExport?
2. DataSchema?
3. DataStructureAndManipulation?
4. ConfigurationAndObservation?
5. CalibrationAlgorithms?
6. DataDisplay?
7. AnalysisProcedures
8. ImagingTools
9. DocumentationAndHelp
10. SoftwareMarketing?
11. CustomerSatisfactionPlan?

Welcome to the home of GB.Data. This is a web-based collaboration area for ...

Welcome to the home of GB.Data. This is a web-based collaboration area designed to facilitate communication, planning, execution and documentation of all tasks related to producing, reducing and analyzing single dish data.

Maintenance of the Data web

Site Tools of the Data Web

• You are currently in the GB.Data web. The color code for this web is a (SPECIFY COLOR) background, so you know where you are.
• If you are not familiar with the GB collaboration tool, please visit WelcomeGuest in the GB.TWiki web first.

• You are currently in the Data web. The color code for this web is this background, so you know where you are.
• If you are not familiar with the GB collaboration platform, please visit WelcomeGuest first.

• WebIndex: Display all GB.Data topics in alphabetical order.

• WebIndex: Display all GB.Data topics in alphabetical order. See also the faster WebTopicList

%META:TOPICINFO{author="PeterThoeny" date="997248001" format="1.0beta2" version="1.1"}% Welcome to the home of GB.Data. This is a web-based collaboration area for ...

• MeetingMinutes?

Maintenance of the Data web

Notes:

• You are currently in the GB.Data web. The color code for this web is a (SPECIFY COLOR) background, so you know where you are.
• If you are not familiar with the GB collaboration tool, please visit WelcomeGuest in the GB.TWiki web first.