What is the Live Music Archive all about?
This audio archive is an online public library of live recordings available for royalty-free, no-cost public downloads. We only host material by trade-friendly artists: those who like the idea of noncommercial distribution of some or all of their live material. Live recordings are a part of our culture and might be lost in 100 years if they're not archived. We think music matters and want to preserve it for future generations.
The LMA draws strength from the members of etree.org and other online communities of music fans devoted to providing public access to high-quality digital recordings of tradable performances. Typically, recordings are made by the fans themselves. Recordings are preserved in "Lossless" archival compression formats such as Shorten or FLAC (MP3 is not Lossless) for highest quality preservation.
Patrons may download from the LMA with the understanding that the artists still hold their copyrights. All material is strictly noncommercial, both for access here and for any further distribution.
I noticed a recording I uploaded and marked for 'no lossy formats' somehow had them created (mp3, ogg, m3u, etc...) and they are being hosted here. How can I remove them so only the lossless format is available?
If you come across this situation and you are the uploader, click [edit] and then 'Update'. You should see the message "Format Options Updated Successfully". Within 10 minutes the system will create a "_rules.conf" file in the recording's folder. Then, the next time the system performs an automatic sweep looking for changes, it will notice the new rules file and remove the lossy files automatically. The sweep occurs approximately twice a day, so you should see the files removed within 12-24 hours.
If you are not the uploader, fill out an error report letting us know that the derivatives shouldn't be there and an admin will remove them when they get to the error report.
Can I log into an FTP server to download these concerts?
Yes, you can log into audioXX.archive.org (where XX is a number), with the username anonymous and use your email address as the password. Each recording will have a link for FTP information that will tell you which number server the show is on, and in which directory.
I allowed derivations to be made on one of my shows, but I changed my mind and checked the box to remove the mp3's. They were removed but now on the show details page is the loss-less whole show link as well as a 64kbps m3u stream link that shouldn't be there anymore. how do i remove it?
This is a known bug that the archive is working on fixing. If you find one of these shows with a 64k m3u stream link left over on it, fill out an error report for that show and a file admin will get to removing it in the order it was received. No derivations are left, so even if a user clicked on the stream link, there would be nothing to play.
What are SHN files?
SHN stands for shorten. It is a lossless compression algorithm for digital music. It was developed by SoftSound and it compresses music files to 50-60% of their original size, with no loss in quality. See this FAQ.
What are MD5 files?
MD5 files contain checksums, strings of characters used to uniquely represent a file. These checksums enable users to verify that music files downloaded correctly.
How can I listen to SHN files?
Macintosh:
Download and install MacAmp Lite, a multi-format audio player, and then install the Shorten Plugin for MacAmp.
Windows:
Download and install WinAmp, a multi-format audio player, and then install the ShnAmp Plugin for WinAmp.
Linux or any other UNIX-based architecture: Download and install the xmms-shn plugin for the XMMS media player.
How do I burn SHN files to CD as audio tracks?
You will first need to convert the SHN files to another format that your burning program is familiar with. The following programs will convert SHN files to WAV files, which can be burned to a CD. More resources are listed in this FAQ.
Macintosh: Download and install Doug Hornig's tool, appropriately titled, Shorten for Macintosh.
Windows: Download and install Michael K. Weise's tool, mkwACT. Or, another good tool is Foobar2000 - make sure you get the "Special" version to have Shorten compatibility!
Linux or any other UNIX-based architecture: Download and install shorten.
There's no setlist for this show - OR - The setlist does not match up with the number of files. Should I submit an error report?
There has been an increasing number of shows uploaded to the Live Music collection without setlist information, or the setlist was not properly matched to the files. When you notice a recording like this, please submit an error report only if you have an updated setlist, or you are able to match the files up correctly.
We would prefer that you do not submit error reports letting us know that there is no setlist - tracking down setlists for every concert and matching them up to the recordings is a monumental task that has grown beyond the capabilities of the small group of Archive.org admins. We would like fans that are familiar with each artist's material to help us with this project - in your error report, please give us specific instructions on what changes to make and we will do so.
How can I download SHN files? They just show up as weird characters in my browser.
To download SHN files on a PC, right click the link to the file, and select "Save Target As". On the Macintosh, hold the button down while the mouse is over the link, and when the menu comes up, select "Save Target As"
What are FLAC files?
FLAC stands for free lossless audio codec. It is an open source, lossless compression algorithm for digital music. It compresses music files to 50-60% of their original size, with no loss in quality. More FLAC information can be found on the FLAC sourceforge site and in this etree FAQ.
If you upload FLAC filesets to the LMA, please follow the naming standards to help the checking program here. Directories should be named with .flac16 or .flac24 suffix, not .flac. Otherwise, the program will report failures.
What are FFP files?
FFP files contain checksums, strings of characters used to uniquely represent a FLAC file. These checksums enable users to verify which particular source a file comes from.
How can I listen to FLAC files?
Macintosh: Download and install MacAmp Lite, a multi-format audio player, and then install the FLAC Plugin for MacAmp.
Windows: Download and install WinAmp, a multi-format audio player, and then install the FLAC Plugin for WinAmp.
Linux or any other UNIX-based architecture: Download and copy "libxmms-flac.so" to your XMMS media player input plugins folder.
How do I burn FLAC files to CD as audio tracks?
You will first need to convert the FLAC files to another format that your burning program is familiar with. Windows users can use the FLAC Frontend, to convert FLAC files to WAV files, which are suitable for burning programs. For Macintosh OS X users, Dan Greuel has created a tool called MacFLAC.
Why are there no shows by band X?
We'd like to make sure that a trade-friendly band would not mind having their shows in the Archive for public download. The best way for us to find out is by getting permission from a band representative or by the band's having an explicit policy that covers this type of site. If there are no shows by the band, either we don't have enough of this information to go forward with archiving, they have declined participation, or we are ready to accept shows but no one has uploaded anything yet. You can check on the status of bands in the Archive here (and see next FAQ question).
Trade-unfriendly bands will not be found in the Archive, nor will otherwise trade-friendly bands who have declined to have material archived here.
Bands, see other relevant FAQs here and here. Patrons, see more about how you can help here.
What is the status of band X for the Archive?
You can check on the status of a band relative to the Archive on the Trade-Friendly Band Information page. We have 3 categories:
May be Archived- Band sections have been activated by Archive admins. Shows can be hosted here to the extent permitted by the band. Click on the band name and then their Notes link to see what limits they may have placed on taping, trading or archiving.
Pending- When a patron adds a fresh entry for an an additional trade-friendly band, the new band section is placed in the Pending category, with default status "Not contacted" in its Notes. Admins will update the contact status based on information that people send to etree@archive.org.
Opted Out- Some bands that may be otherwise trade-friendly may have explicitly said, "No, thanks" to our project. We respect their wishes. We still keep notes of their taping/trading policies for reference.
If there is no listing for a band here, maybe they are not trade-friendly, or no one has thought to create a pending section for them yet. In the latter case, chances are no one has tried contacting the band yet (or if a person has tried, he hasn't told us about it yet).
Bands, see other relevant FAQs here and here. Patrons, see more about how you can help here.
I'm an artist who would like to be included in the Archive, what do I need to do?
We'd love to have you! Just write to us at etree@archive.org in English giving some kind of permission for us to archive your shows for public download and noncommercial, royalty-free circulation. It does not need to be a formally worded declaration, and can come from anyone you feel has the "say-so." We just need to be clear on how you feel about the project. We will put relevant quotes in our Band Information section, along with a link to your official website.
If you happen to make your own Band Information section, it is still necessary to email us in order to activate the section. We want to be sure that the desired listing really is coming from you (more discussion here).
You can give as much or as little scope for archiving as you like. Some bands place limits on what can be hosted, and we can accomodate those. Archive Curators, volunteer fans who have proven to be in line with the spirit of this archive, will attempt to screen contributions for OK'ed material only.
At the same time you give the go-ahead, feel free to pass along any notes or policy links on your general taping/trading stance as well. You don't need to have a formal written or posted policy before inclusion, but we'd like to know how you feel about the topic.
Besides fans' sending their copies of your shows, you can also prepare and upload your own live recordings to the Archive, if you like. In fact, if you'd like to limit your material to selected contributions from you only, please just let us know.
If you have any questions about the project, please ask us anytime at etree@archive.org.
Can I upload concert videos?
At this time, video uploads are not being accepted, namely because most of the bands archived prohibit the video taping of their shows. Moreover, unlike audio, where we actually have a shot at archiving the vast majority of any given band's live concerts (in very high quality format), video is scarce and, unless made by the artist (in which case, it's typically for commercial purposes), is not of particularly good quality.
Why do my download speeds spike violently?
The etree servers are very busy and get very bogged down. Hundreds of downloaders are accessing blocks of disk, each off in a different location. so the disk heads have to move to appropriate block to retrieve it for you. In the mean time, for fairness, the disk heads move off to another location after giving you your block(s) so they can provide another user(s) with some blocks. When that's done, the heads move back to your show and give you a bit more. The more downloaders who are downloading shows in different places on disk, the more pronounced this effect becomes. As we populate more servers with data this may become less of an issue since the demand will be spread over more disks.
How do I upload a show?
Be sure that you are logged in as an Internet Archive member, then click here. The directories and files you upload should be named in accordance with etree.org standards, which can be found here. Additionally, to facilitate the importing of shows, name the top directory like this: bbyyyy-mm-dd.source.shnf
Each show must be in its own, named directory in order to be seen by the importing system.
[Special Admin Note for uploads containing a number in the band abbreviation prefix: In these cases only, please add a dash between the prefix and date in the directory name (foo4tet-2002-02-02.shnf) so the import software will work. Usually, directory names must not have the dash (footet2002-02-02.shnf) to be imported. Numbers in the abbreviation are special cases.]
I have more audio questions...who do I ask?
Feel free to email etree at archive dot org with any questions, and we'll do our best to post the answers here as soon as possible. Also, the message board is a great resource; with so many kind, knowledgable folks out there, you can often get a speedy answer to your question.
I have a different source for a show that is already in the archive, should I upload it anyway?
In keeping with the nature of this Archive, it is appropriate for multiple sources of the same show to be available for download. When you upload the new source, be sure to name the source in the show's top level folder to avoid confusion. Some bands do place limits on the types of sources allowed (such as soundboard recordings), so please check the policy for any given band.
How can I help get bands into the Live Music Archive?
If you know of a trade-friendly live-performing band that is a good candidate for the Archive, you can initiate contact. Some tips and letter templates can be found here. When you write, make it clear you are asking about the Live Music Archive at archive.org. Don't just ask about their general taping/trading stance. We want bands to know what's up.
Next, follow up with a message to etree@archive.org. Mention when you tried to contact the band and what contact point you used. These are important in order to update our contact records. You can create a new "pending" section for the band on the Band Information page if one isn't listed there yet. Admins will update the contact status in that section based on the message you send us.
If you receive a reply from the band, positive or negative, send a complete copy of the email, complete with its sender's address, to etree@archive.org. It's a good idea to send a copy of what you asked them as well (if not quoted in the reply), since it will give context to the answer. We need to have full info in hand in order to set up the band appropriately in the Archive, and we may need to contact them for followup questions.
If you are hesitant to make contact yourself, you can mention the band to Archive admins and they can try a contact as time permits. To help out, first add the band to the Trade-Friendly Band Information page if it is not listed already.
What's the deal with WAV MD5 files?
MD5 cheksums files are not exclusive to SHN files, in fact, an MD5 checksum can be used to ensure the accuracy of any data file (e.g. .doc, .mp3, .mpeg). Some seeders produce MD5 checksums for their WAV files, as well as the SHN files. This is just an extra level of protection to ensure exact copies of the original WAV files are being burned from the SHN files. Checking a WAV file with a MD5 cheksum is no different than checking a SHN file. If you use mkwACT, you can just right click on the wav MD5 and choose "verify."
I just uploaded a directory that contained WAV MD5 checksums, is that OK?
The WAV MD5 checksums are ignored by our robot. Do not worry if you see that the WAV MD5 checksums fail, the shows will be imported as soon as possible.
When I try to connect to a server via FTP, I get the error "connection timeout." How can I fix this?
This error is caused by a setting in your FTP client, that limits the amount of time your FTP client will wait for a server to respond. In order to fix this problem, increase the "server timeout" setting; a setting of 180 seconds should be enough time to connect to the archive.org servers. If you use SmartFTP, the "server timeout" setting can be found in Tools > Settings > Connections.
Can bands place restrictions on material to be archived?
Yes. Each band can tailor the extent of their permission to the Archive. We quote the band's wishes in their section of the Band Information page. Here are some examples of special restrictions bands have requested.
We have a contribution system set up to accomodate individual bands' requirements. During the upload process, contributors are urged to double check the band's policy notes at different stages. Archive Curators, volunteer fans who have proven to be in line with the spirit of this archive, will attempt to screen contributions for OK'ed material only. In addition, access to a particular item can be removed if it becomes restricted later (for example, a date newly chosen for commercial release must be removed under some band's policies).
Bands, please contact us at etree@archive.org anytime to let us know how we can work with you to make things happen.
I just uploaded a show and all the files fail the MD5 check, what's the deal?
Check to make sure the FTP program you used to upload the files is set to "binary" mode. If you try to upload .shn or .flac files in "ASCII" mode the files will fail the MD5 check. ASCII is the standard format for encoding plain text files (actually a subset of binary), while binary is used to encode almost all other types of files. More information on binary vs. ASCII can be found here.
If this does not solve the problem, be sure that all the file names in the MD5 file match the .shn file names. Be aware that the UNIX system the Internet Archive runs on is case-sensitive.
If you upload FLAC filesets to the LMA, please follow the naming standards to help the checking program here. Directories should be named with .flac16 or .flac24 suffix, not .flac. Otherwise, the program will report failures.
Where have all the Dave Matthews Band concerts gone? Will they be back?
At the request of the band's management and as a result of the band's recent policy change, Dave Matthews Band concerts (as well as Dave Matthews solo concerts and Dave and Tim shows) have been removed from the Internet Archive. We're very sorry about this unfortunate turn of events but feel like it is important to honor the wishes of the band and its management.
For more information and discussion see this post:
http://www.archive.org/iathreads/post-view.php?id=3670
Why is there no Phish? What about Widespread Panic?
Phish has decided not to participate in the Archive at this point in time. Their official response can be viewed here.
Similarly, Widespread Panic has opted out of the project for the time being. They were last contacted on 11/9/2004. Their response can be seen here.
I used to use a download manager and now it stopped working. What's the deal?
Download managers increase your download speed by connecting to the server multiple times. Doing this does not significantly increase download speeds but dramatically hurts the performance of the server. If you wish to use queue to download from the HTTP servers, be sure you set your download program to only use one connection at a time.
How do I help make corrections to shows?
Sometimes people make typos or other mistakes on uploads, or leave gaps in info that can be filled in later. You can help supply good information for archived items. Here is the current best method to submit corrections:
If you uploaded the show, you can make the changes to the details page yourself. Make sure you are logged in as the user who uploaded the show and go to the details page of the show you are trying edit. Click on the "edit" link next to the band name at the top of the details page and you will be able to edit the show details including venue, location, source, setlist, etc. Be aware that editing these field will only change the show details of the Archive's database. If you need to make changes to the text file, please follow the steps below and contact an archive administrator.
If you did not upload the show, please click the 'Report Error' button and state concisely and precisely what the problem with that particular show is (If the problem is a missing setlist, please see this FAQ). If there are one or more missing or broken files that you can provide, please re-upload and re-import the entire show under a new directory name, and then hit 'Report Error' for the old, broken show, asking for that show to be removed.
What file formats are accepted for contributions to the Live Music collection here?
Currently, the Live Music Archive will only accept audio files in 2 formats: Shorten (.shn) and FLAC (.flac). Please Note that MKW files (.mkw) are *NOT* an acceptable file format for your contributions because they lack cross-platform compatibility (Mac users are unable to play or decode MKW files)
In addition, please do not upload the lossy files (MP3 or OGG) next to your FLAC or SHN format files - the Archive creates those files automatically, provided that the contributor agrees to having them available. This ensures that all the files here have uniform quality options selected.
Please follow Etree.org's Seeding Guidelines when preparing your contributions for addition to the collection. Pay particular attention to the Naming Standards section. If your contribution does not follow the Naming Standards they set forth, it will be frozen before becoming available to the public and you will be contacted to fix the filenames.
I like adding concerts. Do you have a preference on the way I put in information?
First of all - thank you so much for contributing to the Archive. Yes, here are some guidelines that will help us maintain good records for each concert.
- Do not include HTML in the source and lineage fields.
- Do not repeat information in the notes fields (such as source information, or number of discs). Only include information in the notes fields that is not already in any other field.
- If at all possible, keep absolutely nothing but song names in the setlist (even things like disc splits, set splits, etc. should not be in this field). If possible, putting all song names on one line, separated by commas is wonderful.
- Do not fill in unknown field with questions marks or N/A - just leave them blank. The exception to this guideline is the setlist and source fields (which are mandatory) - in the event that this information is not known, simply write "unknown".
Once again, thank you so much!
Good FTP clients for downloading music
While HTTP is preferred, some users like using FTP. Here are a couple free FTP clients that users have found to be good:
On Windows SmartFTP
On Mac OS-X Transmit
What's the deal with magic number errors?
If you get a magic number error when listening to or decoding a SHN file, the SHN file is most likely corrupt. First, make sure the SHN file passes MD5 verification; if it does not, redownload the file. If the file passes MD5 verification and you are still getting the magic number error, leave am error report via the show details page noting the magic number error and which track the error occurs on. Hopefully others who have download the show will confirm or deny the error. If the error occurs for all downloaders, the seeder will be contacted to provide a new, uncorrupted track. Please note that there is nothing the Internet Archive administrators can do about a magic number error, becuase the only solution to the error is re-encoding the SHN file from the original WAV file.
Do you provide an RSS feed of new updates to the LMA?
Indeed! The URL of the feed is http://www.archive.org/services/collection-rss.php?mediatype=etree&collection;=etree
You can plug this into a front end like AmphetaDesk (available at: http://www.amphetadesk.com)
What does the "Transferred by" field mean?
This field indicates the person who did the original DAT/MD/Cassette to WAV conversion. Also, note that in the case of recordings made directly to laptops there is no transfer.
Why don't I get an email when my uploads fail MD5 checksums?
The system currently only sends emails when MD5 files are included. This means that, if you're uploading FLAC files, you still need to generate and include an MD5 file if you want to receive informational emails about the failures.
A recommended tool for creating these files is MD5summer. Please note that before uploading the MD5 created with this tool you should open the MD5 in a text editor and remove the top 3 lines so the first signature is now flush with the top of the file.
How can I get iTunes to create a new playlist when I stream MP3s?
As an iTunes user, you might have noticed that iTunes loads the Archive's streaming MP3s (M3U files) into your library, and subsequentially the files get shuffled and are out of order. We have come up with a solution to this problem.
Step by step instructions:
- Download this AppleScript application.
- Copy the m3uPlayer application to a permanent location
- Choose some recording in the Archive to stream. This will cause an M3U to download to your default download folder (typically your desktop).
- Click on the downloaded M3U file, hit option-I (or option-click and select Get Info). Change "open with" from ITunes to m3uPlayer (locate it wherever you saved it)
- Click change all so that all future M3U files will open this way
That's it! If you have trouble, post a message to this forum
Thanks to http://www.balnaves.com/archives/000092.php for the code, instructions, and inspiration
How to play OGG files?
On the mac, there is a free component to ogg-ify itunes.
Also vlc plays it.
http://www.macosxhints.com/article.php?story=20020424233612407
Other info to follow.
What is the Laszlo Flash widget?
The Laszlo Flash widget is a program which can be embedded in a web page to play MP3 files. It requires Macromedia Flash.
Currently the widget does not work in IE on the Macintosh.
What are the options for downloading a full recording?
Lossless: A ZIP file containing Shorten files or Flac files. Unlike formats like MP3, lossless formats are true to the original - there is no degradation in quality.
Hi-Fi: A ZIP file containing MP3 files encoded with a variable bit rate to deliver high quality at roughly 160kilobits per second.
Lo-Fi: A ZIP file containing MP3 files encoded at a constant bit rate of 64 kilobits per second. These files are ideal for users with slower Internet connections.
FTP: Using an FTP client you can log in to the Archive's servers and download all of the files at once.
What are the options for streaming a full recording?
Hi-Fi: An MP3 playlist, readable by most players, that has the addresses of MP3 files encoded with a variable bit rate.
Lo-Fi: An MP3 playlist, readable by most players, that has the addresses of MP3 files encoded with at a constant bit rate of 64 kilobits per second. These files are ideal for users with slower Internet connections.
What are the P2P Options links?
The P2P, or peer to peer, option takes advantage of a technology called "magnet links" which distributes the file and may speed up your download. If you have a peer to peer client (such as Shareaza, Kazaa, Gnutella, LimeWire, Morpheus, Bearshare, Xolox, etc.) installed that is configured to handle Magnet links (most do by default), clicking on one of the links under the “Download via P2P” option will automatically launch your P2P client and download the appropriate file. Internet Archive uses the power of peer to peer and magnet links to more efficiently and economically distribute files with the full approval and permission of the artists who created the files.
You generally have three options for downloading, depending on the quality you want and the speed of your connection. The higher the quality - the bigger the file - the longer the download time.
Lossless: A ZIP file containing Shorten files or Flac files. Unlike formats like MP3, lossless formats are true to the original - there is no degradation in quality.
Hi-Fi: A ZIP file containing MP3 files encoded with a variable bit rate to deliver high quality at roughly 160kilobits per second.
Lo-Fi: A ZIP file containing MP3 files encoded at a constant bit rate of 64 kilobits per second. These files are ideal for users with slower Internet connections.
My in-progress upload says ' No metadata describing files found. Waiting for user to enter metadata' - what do I do?
If your upload is stuck in this way, you'll need to click on the show in question in the Contribution Center, then click the 'Edit' button to edit your show. Then you'll need to choose the File Options button, (in the top right) and fill in any missing information in that particular dialog box that pops up. Finally, hit update, and when the contribution engine checks the show again (this can be a few minutes, so you may need to wait a little!), the show should proceed to the next step in the Contribution Engine.
I'm having trouble with a 'blank'/corrupted ZIP file. What do I do?
There are a variety of problems that may be causing this. Here are a couple of the most common.
If you have a Mac running OS X, the default unzip utility (Stuffit) does not deal well with those Archive ZIP files that are 'compressed on the fly'. You may see an empty directory - if so, then try downloading Zip Tools for Mac OS X and using the drag and drop software within that to unzip your download. [Make sure you save your download to your desktop before trying things on it.]
If you're having any trouble with downloads timing out or being incomplete, especially on Windows, then you may be able to use download managers such as GetRight. These will restart your download if it fails. However, some 'ZIP on the fly' downloads don't play well with download managers. If you find that to be the case, the safest thing to do is to download each track individually in a download manager, or use FTP to log in.
When I try to import my upload, I am getting the error message 'This directory or files contained within the directory have illegal characters in the name' What does this mean?
The folder or files that you sent to the upload server have characters in the name that cause problems with the system - so we have designated them "illegal". This includes the following characters in the name:
* ( ) { } [ ] / \ $ % @ # ^ & | < >
In addition, files and folders may *not* have spaces in the naming.
You will need to remove any of these illegal characters in order for the system to accept your contribution.
Can I upload live recordings that were broadcast on XM Radio or Sirius Satellite Radio?
At this point in time, Archive.org cannot host recordings that were broadcast over either of these services. Subscribers have informed us that they were required to sign a "Terms of Use" document that forbids the recording/hosting/rebroadcasting of any material received from these services. Until we hear otherwise, these recordings cannot be hosted here.
The Grateful Dead is here, when will we see Jerry Garcia Band recordings?
The taping policy of the Grateful Dead does not extend to recordings of Jerry Garcia Band. Jerry's solo work is controlled by his estate.
More info here: http://www.archive.org/iathreads/post-view.php?id=18987
Archive.org does not have permission to host his recordings at this time.
Regarding removing the lossy files ... I edited my show, checked the box to remove them and clicked update. Now when I click update again, the box is still not checked. Why?
It takes 2-10 minutes for your checking of that box to 'stick' ... see
this discussion board post: http://www.archive.org/iathreads/post-view.php?id=22816 for an explanation of why.
Can I begin uploading Grateful Dead to the Collection?
At this time, the Grateful Dead section of the collection is not open to public uploads. This status will be lifted when the GDIAP (Grateful Dead Internet Archive Project) has completed importing all of the recordings they have access to. There will be an announcement on the discussion board and this FAQ will be removed when we open the doors for fans to begin filling in the gaps.
|