It looks like you're offline.
Open Library logo

Developers / Data → Diff

Added
Modified
Removed
Not changed
Revision 27 by George March 6, 2010
Revision 44 by raybb March 31, 2026
title Developers / Data Developer Center / Bulk Data
m edit
body
0 [API][1] | **Data** | [Licensing][3] &nbsp;&bull;&nbsp; [Bugs in Launchpad][4] | [Code on GitHub][5] 0 <a name="bulk_download"> </a>
1 ##Bulk Download##
1 2
2 ---------- 3 Open Library provides dumps of all its records in JSON format. If you want to download everything, please use this instead of our [API][8].
4
5 See [Open Library Data Dumps](/developers/dumps) documentation for details.
6
7 ##About the Catalog##
3 8
4 Open Library has a lot of catalog records, over 20 million editions and some 6 million authors. We're always looking for new records too, in addition to those created one-by-one by our patrons. 9 Open Library has a lot of catalog records, over 20 million editions and some 6 million authors. We're always looking for new records too, in addition to those created one-by-one by our patrons.
5 10
6 We always encourage new sources and are eager to explore new partnership opportunities. Since the project's inception, we have developed a process for working with new data feeds and merging them into the Open Library system. 11 We encourage new sources and are eager to explore new partnership opportunities. Since the project's inception, we have developed a process for working with new data feeds and merging them into the Open Library system.
7 12
8 This page is mainly about *sending* data into Open Library. If you're curious about getting data back out in something other than a dump of the entire dataset, [check out our API][5].
9 9
... ...
20 20
21 - Create an archive.org account: [http://www.archive.org/account/login.createaccount.php][6] 25 - Create an archive.org account: [https://archive.org/account/signup][6]
22 - FTP the files to catalog-upload.archive.org using the username (most likely your email address) and password you just created. 26 - <strike>FTP the files to catalog-upload.archive.org using the username (most likely your email address) and password you just created.</strike> This doesn't seem to be working right now.
23 - Contact us and let us know if you have uploaded something. 23 - Contact us and let us know if you have uploaded something.
... ...
31 31
32 We are also analyzing relationships between works (example: all of these editions of Tom Sawyer are all editions the same conceptual work). From this we can add relationships to each object and create new objects (like works). This process is known in the library world as "FRBRization". See [http://frbr.org][7] for more information. <a name="downloads"> </a> 36 We are also analyzing relationships between works (example: all of these editions of Tom Sawyer are all editions the same conceptual work). From this we can add relationships to each object and create new objects (like works). This process is known in the library world as "FRBRization". See [https://en.wikipedia.org/wiki/Functional_Requirements_for_Bibliographic_Records][7] for more information. <a name="downloads"> </a>
33 37
34 ##Bulk Download## 38
39 ##Lending library MARC records##
35 40
36 Open Library provides dump of entire edition and author records in JSON format. If you want to download everything, please use this instead of our [API][8]. 41 We have [105,852 MARC records for lendable books](https://www.archive.org/details/marc_lendable_books) available to download. Use this to add Open Library lendable books to your library catalog.
37 42
38 - [All Records][9]
39 - [Authors][10]
40 - [Editions][11]
41
42 ##BookServer## 42 ##BookServer##
... ...
47 47
48 - [http://www.archive.org/bookserver.php][13] 49 - [https://www.archive.org/bookserver.php][13]
49 - [http://openlibrary.org/dev/docs/bookserver][14] 50 - [https://openlibrary.org/dev/docs/bookserver][14]
50 - [http://github.com/internetarchive/bookserver][15] (code at github) 51 - [https://github.com/internetarchive/bookserver][15] (code at github)
51 52
52 **Example Catalogs** 53 **Example Catalogs**
53 54
54 - [http://bookserver.archive.org/catalog/][16] 55 - [https://bookserver.archive.org/catalog/][16]
55 - [http://bookserver.archive.org/aggregator/][17] 56 - [https://bookserver.archive.org/aggregator/][17]
56 56
... ...
65 65
66  [1]: http://upstream.openlibrary.org/developers/api 67  [5]: https://github.com/openlibrary
67  [2]: http://upstream.openlibrary.org/data 68  [6]: https://archive.org/account/signup
68  [3]: http://upstream.openlibrary.org/developers/licensing 69  [7]: https://en.wikipedia.org/wiki/Functional_Requirements_for_Bibliographic_Records
69  [4]: http://bugs.launchpad.net/openlibrary 70  [8]: https://upstream.openlibrary.org/developers/api
70  [5]: http://github.com/openlibrary 71  [12]: https://archive.org
71  [6]: http://www.archive.org/account/login.createaccount.php 72  [13]: https://www.archive.org/bookserver.php
72  [7]: http://frbr.org 73  [14]: https://openlibrary.org/dev/docs/bookserver
73  [8]: http://upstream.openlibrary.org/developers/api 74  [15]: https://github.com/internetarchive/bookserver
74  [9]: http://www.archive.org/download/oldumps/jsondump.json.gz 75  [16]: https://bookserver.archive.org/catalog/
75  [10]: http://www.archive.org/download/oldumps/authors.json.gz 76  [17]: https://bookserver.archive.org/aggregator/
76  [11]: http://www.archive.org/download/oldumps/editions.json.gz 77  [18]: https://code.google.com/p/openpub/wiki/OPDS
77  [12]: http://archive.org
78  [13]: http://www.archive.org/bookserver.php
79  [14]: http://openlibrary.org/dev/docs/bookserver
80  [15]: http://github.com/internetarchive/bookserver
81  [16]: http://bookserver.archive.org/catalog/
82  [17]: http://bookserver.archive.org/aggregator/
83  [18]: http://code.google.com/p/openpub/wiki/OPDS