Misplaced Pages

Storage Resource Broker: Difference between revisions

Article snapshot taken from Wikipedia with creative commons attribution-sharealike license. Give it a read and then ask your questions in the chat. We can research this topic together.
Browse history interactively← Previous editContent deleted Content addedVisualWikitext
Revision as of 10:17, 31 July 2016 editUshkin N (talk | contribs)Extended confirmed users1,406 edits was data grid management computer software used in computational science research projects - clarify it first← Previous edit Latest revision as of 19:38, 25 July 2023 edit undoCitation bot (talk | contribs)Bots5,406,819 edits Alter: title. Add: chapter, authors 1-1. Removed parameters. Some additions/deletions were parameter name changes. | Use this bot. Report bugs. | Suggested by Headbomb | Linked from Misplaced Pages:WikiProject_Academic_Journals/Journals_cited_by_Wikipedia/Sandbox2 | #UCB_webform_linked 1948/2384 
(19 intermediate revisions by 11 users not shown)
Line 1: Line 1:
{{Multiple issues| {{Multiple issues|
{{technical|date=September 2011}} {{technical|date=September 2011}}
{{refimprove|date=May 2009}} {{more citations needed|date=May 2009}}
}} }}


'''Storage Resource Broker (SRB)''' was ] management ] used in ] research projects. SRB is a logical distributed ] based on a ] which presents users with a single global logical namespace or file hierarchy.<ref>{{Cite web |title= What is the SRB |url= http://www.sdsc.edu/srb/index.php/What_is_the_SRB |work= SRB wiki |date= 16 May 2006 |accessdate= 17 July 2013 }}</ref> '''Storage Resource Broker''' ('''SRB''') is ] management ] used in ] research projects. SRB is a logical distributed ] based on a ] which presents users with a single global logical namespace or file hierarchy.<ref>{{Cite web|title=What is the SRB |url=http://www.sdsc.edu/srb/index.php/What_is_the_SRB |work=SRB wiki |date=16 May 2006 |access-date=17 July 2013 |url-status=dead |archive-url=https://web.archive.org/web/20130702055848/http://www.sdsc.edu/srb/index.php/What_is_the_SRB |archive-date=2 July 2013 }}</ref> Essentially, the software enables a user to use a single mechanism to work with multiple data sources.


==Description== ==Description==
SRB provides a uniform interface to heterogeneous ] resources over a network. As part of this, it implements a logical ] (distinct from physical file names) and maintains ] on data-objects (files), users, groups, resources, collections, and other items in an SRB ] catalog (MCAT) stored in a relational ].<ref>{{Cite journal |title= The SDSC storage resource broker |last1= Baru |first= Chaitanya |first2= Reagan |last2= Moore |first3= Arcot |last3= Rajasekar |first4= Michael |last4= Wan |work= CASCON First Decade High Impact Papers |pages= 189–200 |doi= 10.1145/1925805.1925816 }} (Reprint from November 30 – December 3, 1998)</ref> System and user-defined metadata can be queried to locate files based on attributes as well as by name. SRB runs on various versions of ], ], and ]. SRB provides a uniform interface to heterogeneous ] resources over a network. As part of this, it implements a logical ] (distinct from physical file names) and maintains ] on data-objects (files), users, groups, resources, collections, and other items in an SRB ] catalog (MCAT) stored in a relational ].<ref>{{Cite journal |title= The SDSC storage resource broker |last1= Baru |first1= Chaitanya |first2= Reagan |last2= Moore |first3= Arcot |last3= Rajasekar |first4= Michael |last4= Wan |journal= CASCON First Decade High Impact Papers |pages= 189–200 |doi= 10.1145/1925805.1925816 |year= 2010 |citeseerx= 10.1.1.203.4142 |s2cid= 15937740 }} (Reprint from November 30 – December 3, 1998)</ref> System and user-defined metadata can be queried to locate files based on attributes as well as by name. SRB runs on various versions of ], ], and ].


The SRB system is ] in the sense that it is built on top of other major software packages (various storage systems, real-time data sources, a relational ], etc.) and it has callable library functions that can be utilized by higher level software. However, it is more complete than many middleware software systems as it implements a comprehensive distributed data management environment, including various end-user client applications. It has features to support the management and collaborative (and controlled) sharing, publication, replication, transfer, and preservation of distributed data collections. The SRB system is ] in the sense that it is built on top of other major software packages (various storage systems, real-time data sources, a relational ], etc.) and it has callable library functions that can be utilized by higher level software. However, it is more complete than many middleware software systems as it implements a comprehensive distributed data management environment, including various end-user client applications. It has features to support the management and collaborative (and controlled) sharing, publication, replication, transfer, and preservation of distributed data collections.<ref>{{Cite journal |title= The SDSC storage resource broker |last1= Baru |first1= Chaitanya |first2= Reagan |last2= Moore |first3= Arcot |last3= Rajasekar |first4= Michael |last4= Wan |journal= CASCON First Decade High Impact Papers |pages= 189–200 |doi= 10.1145/1925805.1925816 |year= 2010 |citeseerx= 10.1.1.203.4142 |s2cid= 15937740 }} (Reprint from November 30 – December 3, 1998)</ref>


SRB is sometimes used in conjunction with computational ] systems, such as ], and can utilize the Globus Alliance Grid Security Infrastructure (GSI) ] system. SRB is sometimes used in conjunction with computational ] systems, such as Globus Alliance, and can utilize the Globus Alliance Grid Security Infrastructure (GSI) ] system.


SRB can store and retrieve data in archival storage systems such as the ] and SAM-FS, on disk ]s (Unix, Linux, or Windows), as ]s or tabular data in relational ]s, and on tape libraries. SRB can store and retrieve data in archival storage systems such as the ] and SAM-FS, on disk ]s (Unix, Linux, or Windows), as ]s or tabular data in relational ]s, and on tape libraries.
Line 17: Line 17:
SRB was used since 1997. In 2008 the SRB was estimated to be managing over two petabytes of data. SRB was used since 1997. In 2008 the SRB was estimated to be managing over two petabytes of data.


While licensed, SRB source distributions are freely available to academic and non-profit organizations. ] SRB, a commercial version of SRB, featured capabilities specifically adapted to government and commercial use.<ref>{{Cite web |url= http://www.nirvanastorage.com |title= Nirvana Storage - Home of the Storage Resource Broker (SRB) |work= web site |accessdate= 17 July 2013}}</ref> While licensed, SRB source distributions are freely available to academic and non-profit organizations. ] SRB, a commercial version of SRB, featured capabilities specifically adapted to government and commercial use.<ref>{{Cite web |url= http://www.nirvanastorage.com |title= Nirvana Storage - Home of the Storage Resource Broker (SRB) |work= web site |access-date= 17 July 2013 |archive-url= https://web.archive.org/web/20080724002757/http://www.nirvanastorage.com/ |archive-date= 2008-07-24 |url-status= dead }}</ref>


==History== ==History==
Line 23: Line 23:


SRB builds on the work of Reagan Moore. Moore, a doctorate in plasma physics from UCSD and former computational plasma physicist at General Atomics, joined the San Diego Supercomputer Center at its inception.<ref>{{Dead link |date= July 2013}}</ref> SRB builds on the work of Reagan Moore. Moore, a doctorate in plasma physics from UCSD and former computational plasma physicist at General Atomics, joined the San Diego Supercomputer Center at its inception.<ref>{{Dead link |date= July 2013}}</ref>
A project for a distributed object computation testbed was funded by ] and the ] in 1998 and 1999.<ref>{{Cite web |title= Digging Into Data: Q&A with Reagan Moore |work= SDSC web site |url= http://www.sdsc.edu/profile/rmoore.html |accessdate= 17 July 2013 }}</ref> A project for a distributed object computation testbed was funded by ] and the ] in 1998 and 1999.<ref>{{Cite web|title=Digging Into Data: Q&A with Reagan Moore |work=SDSC web site |url=http://www.sdsc.edu/profile/rmoore.html |access-date=17 July 2013 |url-status=dead |archive-url=https://web.archive.org/web/20130702051923/http://www.sdsc.edu/profile/rmoore.html |archive-date=2 July 2013 }}</ref>


In 2003, ] was granted an exclusive license from UCSD to develop SRB for commercial applications.<ref>{{Cite news |title= General Atomics Acquires Exclusive License from UCSD for Commercialization of Unique Data Management Software |date= 22 September 2003 |work= Press release |publisher= General Atomics |url= http://media.ga.com/2003/09/22/general-atomics-acquires-exclusive-license-from-ucsd-for-commercialization-of-unique-data-management-software/ |accessdate= 17 July 2013 }}</ref> In 2003, ] was granted an exclusive license from UCSD to develop SRB for commercial applications.<ref>{{Cite news |title= General Atomics Acquires Exclusive License from UCSD for Commercialization of Unique Data Management Software |date= 22 September 2003 |work= Press release |publisher= General Atomics |url= http://media.ga.com/2003/09/22/general-atomics-acquires-exclusive-license-from-ucsd-for-commercialization-of-unique-data-management-software/ |accessdate= 17 July 2013 }}</ref>
New versions were announced in 2008 and 2012.<ref>{{Cite news |title= General Atomics, Nirvana Division releases SRB 2008 |date= 29 July 2008 |work= Press release |publisher= General Atomics |url= http://media.ga.com/2008/07/29/general-atomics-nirvana-division-releases-srb-2008/ |accessdate= 17 July 2013 }}</ref><ref>{{Cite news |title= Nirvana SRB 2012 R3® Is Enhanced With Significant Caching Performance, Synchronization and Database Migration Improvements |date= 5 November 2012 |work= Press release |publisher= General Atomics |url= http://media.ga.com/2012/11/05/nirvana-srb-2012-r3-is-enhanced-with-significant-caching-performance-synchronization-and-database-migration-improvements/ |accessdate= 17 July 2013 }}</ref> New versions were announced in 2008 and 2012.<ref>{{Cite news |title= General Atomics, Nirvana Division releases SRB 2008 |date= 29 July 2008 |work= Press release |publisher= General Atomics |url= http://media.ga.com/2008/07/29/general-atomics-nirvana-division-releases-srb-2008/ |accessdate= 17 July 2013 }}</ref><ref>{{Cite news |title= Nirvana SRB 2012 R3® Is Enhanced With Significant Caching Performance, Synchronization and Database Migration Improvements |date= 5 November 2012 |work= Press release |publisher= General Atomics |url= http://media.ga.com/2012/11/05/nirvana-srb-2012-r3-is-enhanced-with-significant-caching-performance-synchronization-and-database-migration-improvements/ |accessdate= 17 July 2013 |archive-date= 12 June 2015 |archive-url= https://web.archive.org/web/20150612180441/http://media.ga.com/2012/11/05/nirvana-srb-2012-r3-is-enhanced-with-significant-caching-performance-synchronization-and-database-migration-improvements/ |url-status= dead }}</ref>


The integrated Rule-based Data management System (iRODS) is a follow-on project of the SDSC SRB team (which became the Data Intensive Cyber Environments group), and largely replaced the use of SRB. iRODS is based on SRB concepts but was completely re-written, includes a highly-configurable rule engine at its core and is fully open source. The integrated Rule-Oriented Data management System (iRODS) is a follow-on project of the SDSC SRB team (which became the Data Intensive Cyber Environments group), and largely replaced the use of SRB. iRODS is based on SRB concepts but was completely re-written, includes a highly-configurable rule engine at its core and is fully open source.
Conferences in 2011 included demonstrations of iRODS.<ref>{{Cite journal |title= Demonstration of Policy-Guided Data Preservation Using iRODS |first1= Mike |last1= Conway |first2= Reagan |last2=Moore |first3= Arcot |last3= Rajasekar |first4= Jean-Yves |last4= Nief |work= Proceedings of the 2011 IEEE International Symposium on Policies for Distributed Systems and Networks |pages= 173–174 |year= 2011 |isbn=978-0-7695-4330-7 |doi= 10.1109/POLICY.2011.17 }}</ref> Conferences in 2011 included demonstrations of iRODS.<ref>{{Cite book |first1= Mike |last1= Conway |first2= Reagan |last2=Moore |first3= Arcot |last3= Rajasekar |first4= Jean-Yves |last4= Nief |title= 2011 IEEE International Symposium on Policies for Distributed Systems and Networks |chapter= Demonstration of Policy-Guided Data Preservation Using iRODS |pages= 173–174 |year= 2011 |isbn=978-0-7695-4330-7 |doi= 10.1109/POLICY.2011.17 |s2cid= 8684444 }}</ref>


==References== ==References==
{{Reflist}}
<references/>
;Bibliography

*{{cite journal|last=Moore|first=R.|date=July 2006|title=Building Preservation Environments with Data Grid Technology|journal=American Archivist|volume=69|issue=1|pages=139–158}} *{{cite journal|last=Moore|first=R.|date=July 2006|title=Building Preservation Environments with Data Grid Technology|journal=American Archivist|volume=69|issue=1|pages=139–158|doi=10.17723/aarc.69.1.176p51l2w5278567|doi-access=free}}
*{{cite journal|last=Moore|first=R.|author2=A. Rajasekar |author3=M. Wan |date=April 2006|title=Storage Resource Broker Global Data Grids|journal=Fourteenth NASA Goddard / Twenty-third IEEE Conference on Mass Storage Systems and Technologies|publisher=NASA / IEEE MSST2006}} *{{cite journal|last=Moore|first=R.|author2=A. Rajasekar |author3=M. Wan |date=April 2006|title=Storage Resource Broker Global Data Grids|journal=Fourteenth NASA Goddard / Twenty-Third IEEE Conference on Mass Storage Systems and Technologies|publisher=NASA / IEEE MSST2006}}
*{{cite journal|last=Rajasekar|first=A.|author2=M. Wan |author3=R. Moore |author4=W. Schroeder |date=May 2006|title=A Prototype Rule-based Distributed Data Management System|journal=HPDC workshop on Next Generation Distributed Data Management|location=Paris, France}} *{{cite journal|last=Rajasekar|first=A.|author2=M. Wan |author3=R. Moore |author4=W. Schroeder |date=May 2006|title=A Prototype Rule-based Distributed Data Management System|journal=HPDC Workshop on Next Generation Distributed Data Management|location=Paris, France}}
*{{cite journal|last=Rajasekar|first=A.|author2=M. Wan |author3=R. Moore |date=March 2009|title=Event Processing in Policy Oriented Data Grids|journal=Proceedings of Intelligent Event Processing AAAI Spring Symposium|location=Stanford, California|pages=61–66}} *{{cite journal|last=Rajasekar|first=A.|author2=M. Wan |author3=R. Moore |date=March 2009|title=Event Processing in Policy Oriented Data Grids|journal=Proceedings of Intelligent Event Processing AAAI Spring Symposium|location=Stanford, California|pages=61–66}}


Line 46: Line 46:
] ]
] ]

{{storage-software-stub}}

Latest revision as of 19:38, 25 July 2023

This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these messages)
This article may be too technical for most readers to understand. Please help improve it to make it understandable to non-experts, without removing the technical details. (September 2011) (Learn how and when to remove this message)
This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.
Find sources: "Storage Resource Broker" – news · newspapers · books · scholar · JSTOR (May 2009) (Learn how and when to remove this message)
(Learn how and when to remove this message)

Storage Resource Broker (SRB) is data grid management computer software used in computational science research projects. SRB is a logical distributed file system based on a client-server architecture which presents users with a single global logical namespace or file hierarchy. Essentially, the software enables a user to use a single mechanism to work with multiple data sources.

Description

SRB provides a uniform interface to heterogeneous computer data storage resources over a network. As part of this, it implements a logical namespace (distinct from physical file names) and maintains metadata on data-objects (files), users, groups, resources, collections, and other items in an SRB metadata catalog (MCAT) stored in a relational database management system. System and user-defined metadata can be queried to locate files based on attributes as well as by name. SRB runs on various versions of Unix, Linux, and Microsoft Windows.

The SRB system is middleware in the sense that it is built on top of other major software packages (various storage systems, real-time data sources, a relational database management system, etc.) and it has callable library functions that can be utilized by higher level software. However, it is more complete than many middleware software systems as it implements a comprehensive distributed data management environment, including various end-user client applications. It has features to support the management and collaborative (and controlled) sharing, publication, replication, transfer, and preservation of distributed data collections.

SRB is sometimes used in conjunction with computational grid computing systems, such as Globus Alliance, and can utilize the Globus Alliance Grid Security Infrastructure (GSI) authentication system.

SRB can store and retrieve data in archival storage systems such as the High Performance Storage System and SAM-FS, on disk file systems (Unix, Linux, or Windows), as binary large objects or tabular data in relational database management systems, and on tape libraries.

SRB was used since 1997. In 2008 the SRB was estimated to be managing over two petabytes of data.

While licensed, SRB source distributions are freely available to academic and non-profit organizations. Nirvana SRB, a commercial version of SRB, featured capabilities specifically adapted to government and commercial use.

History

SRB development began in 1995, through the cooperative efforts of General Atomics, the Data Intensive Cyber Environments Group (DICE), and the San Diego Supercomputer Center (SDSC) at the University of California, San Diego (UCSD) with the support of the National Science Foundation (NSF).

SRB builds on the work of Reagan Moore. Moore, a doctorate in plasma physics from UCSD and former computational plasma physicist at General Atomics, joined the San Diego Supercomputer Center at its inception. A project for a distributed object computation testbed was funded by DARPA and the US Patent and Trademark Office in 1998 and 1999.

In 2003, General Atomics was granted an exclusive license from UCSD to develop SRB for commercial applications. New versions were announced in 2008 and 2012.

The integrated Rule-Oriented Data management System (iRODS) is a follow-on project of the SDSC SRB team (which became the Data Intensive Cyber Environments group), and largely replaced the use of SRB. iRODS is based on SRB concepts but was completely re-written, includes a highly-configurable rule engine at its core and is fully open source. Conferences in 2011 included demonstrations of iRODS.

References

  1. "What is the SRB". SRB wiki. 16 May 2006. Archived from the original on 2 July 2013. Retrieved 17 July 2013.
  2. Baru, Chaitanya; Moore, Reagan; Rajasekar, Arcot; Wan, Michael (2010). "The SDSC storage resource broker". CASCON First Decade High Impact Papers: 189–200. CiteSeerX 10.1.1.203.4142. doi:10.1145/1925805.1925816. S2CID 15937740. (Reprint from November 30 – December 3, 1998)
  3. Baru, Chaitanya; Moore, Reagan; Rajasekar, Arcot; Wan, Michael (2010). "The SDSC storage resource broker". CASCON First Decade High Impact Papers: 189–200. CiteSeerX 10.1.1.203.4142. doi:10.1145/1925805.1925816. S2CID 15937740. (Reprint from November 30 – December 3, 1998)
  4. "Nirvana Storage - Home of the Storage Resource Broker (SRB)". web site. Archived from the original on 2008-07-24. Retrieved 17 July 2013.
  5. "San Diego Business Journal", 29 September 2003
  6. "Digging Into Data: Q&A with Reagan Moore". SDSC web site. Archived from the original on 2 July 2013. Retrieved 17 July 2013.
  7. "General Atomics Acquires Exclusive License from UCSD for Commercialization of Unique Data Management Software". Press release. General Atomics. 22 September 2003. Retrieved 17 July 2013.
  8. "General Atomics, Nirvana Division releases SRB 2008". Press release. General Atomics. 29 July 2008. Retrieved 17 July 2013.
  9. "Nirvana SRB 2012 R3® Is Enhanced With Significant Caching Performance, Synchronization and Database Migration Improvements". Press release. General Atomics. 5 November 2012. Archived from the original on 12 June 2015. Retrieved 17 July 2013.
  10. Conway, Mike; Moore, Reagan; Rajasekar, Arcot; Nief, Jean-Yves (2011). "Demonstration of Policy-Guided Data Preservation Using iRODS". 2011 IEEE International Symposium on Policies for Distributed Systems and Networks. pp. 173–174. doi:10.1109/POLICY.2011.17. ISBN 978-0-7695-4330-7. S2CID 8684444.
Bibliography
  • Moore, R. (July 2006). "Building Preservation Environments with Data Grid Technology". American Archivist. 69 (1): 139–158. doi:10.17723/aarc.69.1.176p51l2w5278567.
  • Moore, R.; A. Rajasekar; M. Wan (April 2006). "Storage Resource Broker Global Data Grids". Fourteenth NASA Goddard / Twenty-Third IEEE Conference on Mass Storage Systems and Technologies. NASA / IEEE MSST2006.
  • Rajasekar, A.; M. Wan; R. Moore; W. Schroeder (May 2006). "A Prototype Rule-based Distributed Data Management System". HPDC Workshop on Next Generation Distributed Data Management. Paris, France.
  • Rajasekar, A.; M. Wan; R. Moore (March 2009). "Event Processing in Policy Oriented Data Grids". Proceedings of Intelligent Event Processing AAAI Spring Symposium. Stanford, California: 61–66.

External links

Categories: