Skip to content

Cmip5Status|Tests

Jump to bottom Edit New page
Matthew Harris edited this page Oct 9, 2013 · 6 revisions

Objective

The objective of this plan is to verify a working ESG Gateways and Data Nodes Federation. This is meant as distinct from unit and integration testing of individual software components developed for ESG. Rather it means the verification that all the deployed software at the different partner sites can correctly interoperate. Implicit then in this is a focus on the interfaces involved in site to site interactions. The ESGF Security ICD specifies what these are. All interfaces in all deployments should be tested and probed to ensure compliance with requirements outlined in the ICD and the requirements of the underlying specifications used. e.g. SAML, OpenID.

Methodology

Identify a Baseline

The starting point is to define what is the target system for testing:

  • Which institutions are covered? - PCMDI, ORNL, NCAR, BADC, DKRZ, JPL.
  • What components are deployed at each institution? The deployment matrix lists this information.
  • What are the software versions and host environments?

Testing Approach

Adopt a layered approach to testing.

  • At the base level define tests based on specifications, protocols which cross-cut all components. These may be suitable for automation with test scripts.
  • Build on this with tests for the individual interfaces with emphasis on verification of services involving institution - institution interactions.
  • At the next level, walk-throughs - scenarios which probe the full functioning of the system. For example, a user registers for CMIP5 access, receives confirmation of membership and then access data from a Data Node secured with that authorisation role.

Failure at a given level of testing precludes continuation of any further higher level tests. There are multiple implementations of some interfaces - SAML and OpenID. Testing services deployed with the different implementations will provide a more robust test of the system. e.g. Python SAML client calls Java SAML service.

See also

Key Federation Testing Tasks

Communication

The mailing list " esgf-federation-testing " focuses on all things related to federation testing: To join the mailing list send email to majordomo@lists.llnl.gov . In the body of the email put "subscribe esgf-federation-testing".

Integration Tests

[ Integration Tests ](https://github.com/ESGF/esgf.github.io/wiki/Cmip5Status| Tests|IntegrationTests)

Cross Cutting Tests

[ Cross Cutting Tests ](https://github.com/ESGF/esgf.github.io/wiki/Cmip5Statu s|Tests|CrossCuttingTests)

Interface Level Tests

[ Interface Tests ](https://github.com/ESGF/esgf.github.io/wiki/Cmip5Status|Te sts|InterfaceTests)

Replication Tests

[ Replication Tests ](https://github.com/ESGF/esgf.github.io/wiki/Cmip5Status| Tests|ReplicationTests)

Notes regarding tests

  • Stress / Loading tests?
  • Basic system requirements and some way to document that.
  • QC Use cases from Bryan Lawrence
  • Standalone client tools to test these
  • Verify data node publication - tests (register, setup attributes)
  • Trust everyone in the federation.
  • Can you trust additional entities?
  • Is there a single stack across all the federation? If there is, many of these tests can be made into unit tests, and probe only configurable pieces.
  • If we automate this as part of monitoring service, how would the credentials and test be setup.
  • Session cookies only on the server side, short term credentials and CRLs for revocations
  • Do performance test to see how it affects user experience to redirect to the ORP each time the session cookie expires
  • Caching of attributes and authorization decisions
  • PCDMI Attribute Service is a critical service, and has high risk profile and should have scalability solutions and fail-over solution.

Gateway endpoints

In order for OpenID SSO to work among Gateways, each Gateway database must have an entry corresponding for all other Gateways. ESGF will eventually develop a sophisticated registry system, but in the meantime in order to conduct federation testing, each Gateway administrator must manually insert the following entries in the database:

WDCC Gateways

-- Albedo2 Test gateway (External)
INSERT INTO metadata.gateway (id, name, description, base_url, base_secure_url, attributes_service_url, oai_repository_url, identity, administrator_personal, administrator_email, myproxy_endpoint, idp_endpoint, metadata_profile_id) VALUES ('a1bed020-835e-4fdb-8fbc-0be206191027', 'ESG-WDCC2', 'Earth System Grid gateway at the World Data Center for Climate', 'http://albedo2.dkrz.de/esgcet', 'https://albedo2.dkrz.de/esgcet', 'https://albedo2.dkrz.de/esgcet/saml/soap/secure/attributeService.htm', 'https://albedo2.dkrz.de/esgcet/oai/repository.htm', 'CN=albedo2.dkrz.de, OU=WDCC, O=DKRZ, C=DE', 'ESG Gateway Administrator', 'estanislao.gonzalez AT zmaw.de', 'albedo2.dkrz.de:7512', 'https://albedo2.dkrz.de/esgcet/openid/provider.htm','342bb71a-01bd-479e-b837-de8133464733');

-- IPCC-AR5 gateway
INSERT INTO metadata.gateway (id, name, description, base_url, base_secure_url, attributes_service_url, oai_repository_url, identity, administrator_personal, administrator_email, myproxy_endpoint, idp_endpoint, metadata_profile_id) VALUES ('1bcca350-835e-4fdb-8fbc-0be206191027', 'ESG-WDCC', 'Earth System Grid gateway at the World Data Center for Climate', 'http://ipcc-ar5.dkrz.de', 'https://ipcc-ar5.dkrz.de', 'https://ipcc-ar5.dkrz.de/saml/soap/secure/attributeService.htm', 'https://ipcc-ar5.dkrz.de/oai/repository.htm', 'CN=ipcc-ar5.dkrz.de, OU=WDCC, O=DKRZ, C=DE', 'ESG Gateway Administrator', 'estanislao.gonzalez AT zmaw.de', 'ipcc-ar5.dkrz.de:7512', 'https://ipcc-ar5.dkrz.de/openid/provider.htm', '342bb71a-01bd-479e-b837-de8133464733');

NASA/JPL Gateway

INSERT INTO metadata.gateway (id, name, description, base_url, base_secure_url, attributes_service_url, oai_repository_url, identity, administrator_personal, administrator_email, myproxy_endpoint, idp_endpoint, metadata_profile_id) VALUES ('06a37cfd-5ca5-4e5a-bc6b-797dbdace482', 'ESG-JPL', 'Earth System Grid gateway at the Jet Propulsion Laboratory', 'http://esg-gateway.jpl.nasa.gov/', 'https://esg-gateway.jpl.nasa.gov/', 'https://esg-gateway.jpl.nasa.gov/saml/soap/secure/attributeService.htm', 'http://esg-gateway.jpl.nasa.gov/oai/repository.htm', 'CN=esg-jpl.jpl.nasa.gov, OU=Services, DC=doegrids, DC=org', 'ESG-JPL Administrator', 'administrator AT esg-jpl.jpl.nasa.gov', 'esg-jpl.jpl.nasa.gov:7512', 'https://esg-gateway.jpl.nasa.gov/openid/provider.htm', '342bb71a-01bd-479e-b837-de8133464733');



-- ESG-BADC-TEST Gateway
INSERT INTO metadata.gateway (id, name, description,  base_url, base_secure_url, attributes_service_url, oai_repository_url, identity, project_view_handler_name, collection_view_handler_name, metadata_profile_id, administrator_personal, administrator_email, myproxy_endpoint, idp_endpoint) VALUES ('23fc66d2-9cdc-425d-bec4-552e002d6b56', 'ESG-BADC-TEST', 'British Atmospheric Data Centre', 'http://cmip-gw2.badc.rl.ac.uk/', 'https://cmip-gw2.badc.rl.ac.uk/', 'https://cmip-gw2.badc.rl.ac.uk/saml/soap/secure/attributeService.htm', 'http://cmip-gw2.badc.rl.ac.uk/oai/repository.htm', 'CN=cmip-gw2.badc.rl.ac.uk, O=Science and Technology Facilities Council, ST=Science and Technology Facilities Council', 'defaultProjectViewHandler', 'defaultCollectionViewHandler', '342bb71a-01bd-479e-b837-de8133464733', 'ESG-BADC Gateway Administrator', 'Maurizio.Nagni@stfc.rl.ac.uk', 'myproxy.ceda.ac.uk:7512', NULL);

-- ESG-BADC Gateway
INSERT INTO metadata.gateway (id, name, description,  base_url, base_secure_url, attributes_service_url, oai_repository_url, identity, project_view_handler_name, collection_view_handler_name, metadata_profile_id, administrator_personal, administrator_email, myproxy_endpoint, idp_endpoint)
VALUES ('5abbeca4-835e-4fdb-8fbc-0be206191027', 'ESG-BADC', 'British Atmospheric Data Centre', 'http://cmip-gw.badc.rl.ac.uk/', 'https://cmip-gw.badc.rl.ac.uk/', 'https://cmip-gw.badc.rl.ac.uk/saml/soap/secure/attributeService.htm', 'http://cmip-gw.badc.rl.ac.uk/oai/repository.htm', 'CN=cmip-gw.badc.rl.ac.uk, O=Science and Technology Facilities Council, ST=Science and Technology Facilities Council', 'defaultProjectViewHandler', 'defaultCollectionViewHandler', '342bb71a-01bd-479e-b837-de8133464733', 'ESG-BADC Gateway Administrator', 'Maurizio.Nagni@stfc.rl.ac.uk', 'myproxy.ceda.ac.uk:7512', NULL);



-- ESG-NERSC Gateway
INSERT INTO metadata.gateway (id, name, description,  base_url, base_secure_url, attributes_service_url, oai_repository_url, identity, project_view_handler_name, collection_view_handler_name, metadata_profile_id, administrator_personal, administrator_email, myproxy_endpoint, idp_endpoint) VALUES ('11fc66d2-9cdc-425d-bec4-552e002d6b56', 'ESG-NERSC', 'ESG-NERSC ', 'http://esg.nersc.gov/esgcet/', 'https://esg.nersc.gov/esgcet/', 'https://esg.nersc.gov/esgcet/saml/soap/secure/attributeService.htm', 'http://esg.nersc.gov/esgcet/oai/repository.htm', 'CN=NERSC Gateway CA, OU=esg.nersc.gov, OU=ESG-NERSC, O=ESG', 'defaultProjectViewHandler', 'defaultCollectionViewHandler', '342bb71a-01bd-479e-b837-de8133464733', 'ESG-NERSC Gateway Administrator', 'mbalman@nersc.gov', 'esg.nersc.gov:7512', 'https://esg.nersc.gov/esgcet/openid/provider.htm');

ESGF_Wiki: Cmip5Status/Tests (last edited 2011-01-17 22:48:41 by [

Add a custom footer
Add a custom sidebar

Clone this wiki locally