It looks like you're offline.
Open Library logo

Developers / Data → Diff

Added
Modified
Removed
Not changed
Revision 29 by Lance Arthur March 10, 2010
Revision 44 by raybb March 31, 2026
title Developers / Data Developer Center / Bulk Data
m edit
body
0 <a name="bulk_download"> </a>
1 ##Bulk Download##
2
3 Open Library provides dumps of all its records in JSON format. If you want to download everything, please use this instead of our [API][8].
4
5 See [Open Library Data Dumps](/developers/dumps) documentation for details.
6
7 ##About the Catalog##
8
0 Open Library has a lot of catalog records, over 20 million editions and some 6 million authors. We're always looking for new records too, in addition to those created one-by-one by our patrons. 9 Open Library has a lot of catalog records, over 20 million editions and some 6 million authors. We're always looking for new records too, in addition to those created one-by-one by our patrons.
1 10
2 We always encourage new sources and are eager to explore new partnership opportunities. Since the project's inception, we have developed a process for working with new data feeds and merging them into the Open Library system. 11 We encourage new sources and are eager to explore new partnership opportunities. Since the project's inception, we have developed a process for working with new data feeds and merging them into the Open Library system.
3 12
4 This page is mainly about *sending* data into Open Library. If you're curious about getting data back out in something other than a dump of the entire dataset, [check out our API][5].
5 5
... ...
16 16
17 - Create an archive.org account: [http://www.archive.org/account/login.createaccount.php][6] 25 - Create an archive.org account: [https://archive.org/account/signup][6]
18 - FTP the files to catalog-upload.archive.org using the username (most likely your email address) and password you just created. 26 - <strike>FTP the files to catalog-upload.archive.org using the username (most likely your email address) and password you just created.</strike> This doesn't seem to be working right now.
19 - Contact us and let us know if you have uploaded something. 19 - Contact us and let us know if you have uploaded something.
... ...
27 27
28 We are also analyzing relationships between works (example: all of these editions of Tom Sawyer are all editions the same conceptual work). From this we can add relationships to each object and create new objects (like works). This process is known in the library world as "FRBRization". See [http://frbr.org][7] for more information. <a name="downloads"> </a> 36 We are also analyzing relationships between works (example: all of these editions of Tom Sawyer are all editions the same conceptual work). From this we can add relationships to each object and create new objects (like works). This process is known in the library world as "FRBRization". See [https://en.wikipedia.org/wiki/Functional_Requirements_for_Bibliographic_Records][7] for more information. <a name="downloads"> </a>
29 37
30 ##Bulk Download## 38
39 ##Lending library MARC records##
31 40
32 Open Library provides dump of entire edition and author records in JSON format. If you want to download everything, please use this instead of our [API][8]. 41 We have [105,852 MARC records for lendable books](https://www.archive.org/details/marc_lendable_books) available to download. Use this to add Open Library lendable books to your library catalog.
33 42
34 - [All Records][9]
35 - [Authors][10]
36 - [Editions][11]
37
38 We're looking forward to making the API more flexible so you don't have to download the whole thing in chunks.
39
40 ##BookServer## 40 ##BookServer##
... ...
45 45
46 - [http://www.archive.org/bookserver.php][13] 49 - [https://www.archive.org/bookserver.php][13]
47 - [http://openlibrary.org/dev/docs/bookserver][14] 50 - [https://openlibrary.org/dev/docs/bookserver][14]
48 - [http://github.com/internetarchive/bookserver][15] (code at github) 51 - [https://github.com/internetarchive/bookserver][15] (code at github)
49 52
50 **Example Catalogs** 53 **Example Catalogs**
51 54
52 - [http://bookserver.archive.org/catalog/][16] 55 - [https://bookserver.archive.org/catalog/][16]
53 - [http://bookserver.archive.org/aggregator/][17] 56 - [https://bookserver.archive.org/aggregator/][17]
54 54
... ...
63 63
64  [5]: http://github.com/openlibrary 67  [5]: https://github.com/openlibrary
65  [6]: http://www.archive.org/account/login.createaccount.php 68  [6]: https://archive.org/account/signup
66  [7]: http://frbr.org 69  [7]: https://en.wikipedia.org/wiki/Functional_Requirements_for_Bibliographic_Records
67  [8]: http://upstream.openlibrary.org/developers/api 70  [8]: https://upstream.openlibrary.org/developers/api
68  [9]: http://www.archive.org/download/oldumps/jsondump.json.gz 71  [12]: https://archive.org
69  [10]: http://www.archive.org/download/oldumps/authors.json.gz 72  [13]: https://www.archive.org/bookserver.php
70  [11]: http://www.archive.org/download/oldumps/editions.json.gz 73  [14]: https://openlibrary.org/dev/docs/bookserver
71  [12]: http://archive.org 74  [15]: https://github.com/internetarchive/bookserver
72  [13]: http://www.archive.org/bookserver.php 75  [16]: https://bookserver.archive.org/catalog/
73  [14]: http://openlibrary.org/dev/docs/bookserver 76  [17]: https://bookserver.archive.org/aggregator/
74  [15]: http://github.com/internetarchive/bookserver 77  [18]: https://code.google.com/p/openpub/wiki/OPDS
75  [16]: http://bookserver.archive.org/catalog/
76  [17]: http://bookserver.archive.org/aggregator/
77  [18]: http://code.google.com/p/openpub/wiki/OPDS