It looks like you're offline.
Open Library logo

Developers / Data → Diff

Added
Modified
Removed
Not changed
Revision 28 by George March 6, 2010
Revision 44 by raybb March 31, 2026
body
0 [API][1] | **Data** | [Licensing][3] &nbsp;&bull;&nbsp; [Bugs in Launchpad][4] | [Code on GitHub][5] 0 <a name="bulk_download"> </a>
1 ##Bulk Download##
1 2
2 ---------- 3 Open Library provides dumps of all its records in JSON format. If you want to download everything, please use this instead of our [API][8].
4
5 See [Open Library Data Dumps](/developers/dumps) documentation for details.
6
7 ##About the Catalog##
3 8
4 Open Library has a lot of catalog records, over 20 million editions and some 6 million authors. We're always looking for new records too, in addition to those created one-by-one by our patrons. 9 Open Library has a lot of catalog records, over 20 million editions and some 6 million authors. We're always looking for new records too, in addition to those created one-by-one by our patrons.
5 10
6 We always encourage new sources and are eager to explore new partnership opportunities. Since the project's inception, we have developed a process for working with new data feeds and merging them into the Open Library system. 11 We encourage new sources and are eager to explore new partnership opportunities. Since the project's inception, we have developed a process for working with new data feeds and merging them into the Open Library system.
7 12
8 This page is mainly about *sending* data into Open Library. If you're curious about getting data back out in something other than a dump of the entire dataset, [check out our API][5].
9 9
... ...
20 20
21 - Create an archive.org account: [http://www.archive.org/account/login.createaccount.php][6] 25 - Create an archive.org account: [https://archive.org/account/signup][6]
22 - FTP the files to catalog-upload.archive.org using the username (most likely your email address) and password you just created. 26 - <strike>FTP the files to catalog-upload.archive.org using the username (most likely your email address) and password you just created.</strike> This doesn't seem to be working right now.
23 - Contact us and let us know if you have uploaded something. 23 - Contact us and let us know if you have uploaded something.
... ...
31 31
32 We are also analyzing relationships between works (example: all of these editions of Tom Sawyer are all editions the same conceptual work). From this we can add relationships to each object and create new objects (like works). This process is known in the library world as "FRBRization". See [http://frbr.org][7] for more information. <a name="downloads"> </a> 36 We are also analyzing relationships between works (example: all of these editions of Tom Sawyer are all editions the same conceptual work). From this we can add relationships to each object and create new objects (like works). This process is known in the library world as "FRBRization". See [https://en.wikipedia.org/wiki/Functional_Requirements_for_Bibliographic_Records][7] for more information. <a name="downloads"> </a>
33 37
34 ##Bulk Download## 38
39 ##Lending library MARC records##
35 40
36 Open Library provides dump of entire edition and author records in JSON format. If you want to download everything, please use this instead of our [API][8]. 41 We have [105,852 MARC records for lendable books](https://www.archive.org/details/marc_lendable_books) available to download. Use this to add Open Library lendable books to your library catalog.
37 42
38 - [All Records][9]
39 - [Authors][10]
40 - [Editions][11]
41
42 We're looking forward to making the API more flexible so you don't have to download the whole thing in chunks.
43
44 ##BookServer## 44 ##BookServer##
... ...
49 49
50 - [http://www.archive.org/bookserver.php][13] 49 - [https://www.archive.org/bookserver.php][13]
51 - [http://openlibrary.org/dev/docs/bookserver][14] 50 - [https://openlibrary.org/dev/docs/bookserver][14]
52 - [http://github.com/internetarchive/bookserver][15] (code at github) 51 - [https://github.com/internetarchive/bookserver][15] (code at github)
53 52
54 **Example Catalogs** 53 **Example Catalogs**
55 54
56 - [http://bookserver.archive.org/catalog/][16] 55 - [https://bookserver.archive.org/catalog/][16]
57 - [http://bookserver.archive.org/aggregator/][17] 56 - [https://bookserver.archive.org/aggregator/][17]
58 58
... ...
67 67
68  [1]: http://upstream.openlibrary.org/developers/api 67  [5]: https://github.com/openlibrary
69  [2]: http://upstream.openlibrary.org/data 68  [6]: https://archive.org/account/signup
70  [3]: http://upstream.openlibrary.org/developers/licensing 69  [7]: https://en.wikipedia.org/wiki/Functional_Requirements_for_Bibliographic_Records
71  [4]: http://bugs.launchpad.net/openlibrary 70  [8]: https://upstream.openlibrary.org/developers/api
72  [5]: http://github.com/openlibrary 71  [12]: https://archive.org
73  [6]: http://www.archive.org/account/login.createaccount.php 72  [13]: https://www.archive.org/bookserver.php
74  [7]: http://frbr.org 73  [14]: https://openlibrary.org/dev/docs/bookserver
75  [8]: http://upstream.openlibrary.org/developers/api 74  [15]: https://github.com/internetarchive/bookserver
76  [9]: http://www.archive.org/download/oldumps/jsondump.json.gz 75  [16]: https://bookserver.archive.org/catalog/
77  [10]: http://www.archive.org/download/oldumps/authors.json.gz 76  [17]: https://bookserver.archive.org/aggregator/
78  [11]: http://www.archive.org/download/oldumps/editions.json.gz 77  [18]: https://code.google.com/p/openpub/wiki/OPDS
79  [12]: http://archive.org
80  [13]: http://www.archive.org/bookserver.php
81  [14]: http://openlibrary.org/dev/docs/bookserver
82  [15]: http://github.com/internetarchive/bookserver
83  [16]: http://bookserver.archive.org/catalog/
84  [17]: http://bookserver.archive.org/aggregator/
85  [18]: http://code.google.com/p/openpub/wiki/OPDS
title Developers / Data Developer Center / Bulk Data
m edit