Digging into the Deep Web
Download as PPT, PDF4 likes2,077 views
The document discusses strategies for searching the deep web, which contains information that is not accessible through standard search engines. It defines the deep web as content that requires login credentials, is protected from robots, or is more than three clicks deep. The document provides tips for mapping concepts, using appropriate tools from the library such as databases and reference sources, and following leads to fully explore topics in the deep web. It emphasizes refining searches and adapting search strategies to uncover elusive information.
Digging into the Deep Web
- 1. Dig into the Deep Web Going on a treasure hunt… Wendy Sellors MLWGS, March 2008 By cameronparkins
- 2. How do sources get buried? Requires log-on Accessed by query Protected from robots Public access expired Can’t be bookmarked (scripted, dynamic, etc.) More than 3 clicks deep (He, et al., 2007)
- 3. How big is the deep web? Conflicting answers… 91,000 terabytes (Deep Web, n.d.) 500x larger than surface (Sullivan as cited in He, et al., 2007) 63% (He, et al., 2007) - 95% of web (Dash, 2007)
- 4. = 1/3 Note: Alltheweb is powered by Yahoo!
- 5. What’s in the treasure chest? Images and multimedia files, including the content of many online exhibits Diaries, letters, historic maps Patents, laws, bills, and treaties Articles licensed/protected by copyright “ Old” newspaper articles (esp. pre-1980’s) Collections of papers, preprints (conference, etc.) Declassified documents, Congressional testimony Government reports, data sets And much more…
- 6. Strategies for finding an X, and then digging for… By merfam
- 7. Why search for it? By brittanyg
- 8. Treasure Hunt Mapping Planning Selecting the proper tools Digging
- 9. (Concept) mapping Broader concepts Browse down into categories of directories Browse down into archives, databases, etc. Check subject headings of databases using its internal Subject Search, Thesaurus search, etc. Related/narrower concepts Amend your map as you search Note subject headings of valuable finds Note key words in valuable finds
- 10. Preparing for the journey Reference Shelf page of library site Reference articles in ebooks, books General and subject encyclopedias Reference books from Gale PowerSearch – Books tab U.S. and World History RC’s – Reference tab Biography, Science, and Literature RC’s Google Book/Worldcat
- 11. Databases Reference shelf Open sources for research Library research wiki – Model UN
- 14. The U.S. and World History RC’s include American Decades, American Eras, American Journeys, Encyclopedia of World Cultures, History in Dispute, World Eras, and many more reference sources…
- 15. Preparing for the journey Finding reference sources, overviews, etc. Recommended sources from Wikipedia/EB Literature reviews Reference lists Further/recommended reading lists Briefs/reports from Congressional Research Service, State Dept, think tanks, RAND, etc. Finding compilations of sources Search subject + bibliography, research guide, resource guide, study guide
- 17. Search for promising book titles in Google Book…
- 18. View the table of contents and index, and/or search for term in book. 6. Ancient Fuel for a Modern Inferno: Time Collapse in Bosnia-Herzegovina
- 20. Tools for the dig MW databases Gale resources Gale PowerSearch Biography Resource Center Expanded Academic ASAP Opposing Viewpoints Resource Center U.S. and World History Resource Centers Declassified Documents (postWW2-1970s) JSTOR & Project MUSE LexisNexis Scholastic
- 21. Digging tips Gale Reference sources Search by broad concept See Reference / Books result tabs Refine by document type Go beyond PowerSearch Follow leads within and between databases Journal/mag/news articles & primary sources Start broad, then narrow Use Advanced search to combine keywords and subject headings
- 22. Multimedia includes transcripts, podcasts, photographs, videos, etc.
- 23. Digging tips JSTOR and Project MUSE Use Advanced Search In general, limit to articles If looking for books, limit to reviews JSTOR Refine by limiting by discipline and/or date range Project MUSE Refine by combining key word and subject searching May also refine by limiting to All Except Text
- 24. Digging tips LexisNexis Supreme court decisions Laws News General Regional Foreign news sources Wires Transcripts
- 25. Tools for the dig VCU databases Browse by topic Search by journal title or article citation Follow to find in other databases Not in a database? Check online catalog for copies in print, and on microfilm or microfiche VCU is also a government repository VCU library’s resource guides
- 26. Tools for the dig Federated search tools e.g. Google Scholar, USAsearch.gov Finding tools = portals in library’s bookmarks Directories e.g. Infomine, Intute Finding tools = directories in library’s bookmarks Metasearch engines e.g. Clusty, Dogpile Finding tools = metasearch in library’s bookmarks
- 27. Clusty searches Ask, Gigablast, Live, Open Directory, Wikipedia Dopgile searches Ask, MSN, Yahoo and Google (note: first result = ad)
- 28. Bookmarks for MW Library - focus on the Finding Tools bundle (on right) or browse by source type or topic tag
- 29. Tools for the dig Search for search tools Finding tools = portals, directories, metasearch Search subject + directory, portal , or search Social bookmarking sites del.icio.us digg stumbleupon
- 30. Choose the right Google Google Book Google Scholar Google News Save customizations Specify news source location Available for other countries Set up news alerts Google by country Google custom search engine By shawnbot
- 31. Surveying the landscape Who cares about this topic? Where do these people live/gather? Research centers Regulating/monitoring agencies Professional/stakeholder organizations Where would their work be collected? Key publications, conferences, databases Historical societies, museums, galleries
- 32. Search subject + studies, center, research center, conference, library
- 34. The elusive X “ X” marks the spot Finding Tools = archives, databases Find Source by Type = statistics, govdocs, etc. Search subject + archive, database, collection, exhibit, statistics , library or desired source type Searching within expert / stakeholder sites e.g. Yale Genocide Program, Amnesty International Use site search feature or view site map Follow leads
- 35. Even sites of less established, authoritative sources may offer clues…
- 37. Try searching Google Book directly (instead of with known title), and click Find this book in a library …
- 39. Staying on track Stop periodically See where you are Reflect on what you’ve found/learned Decide where to look next Follow leads Amend your (concept) map Take notes (interacting vs. pasting) Document your sources
- 40. By ninjaneil902
- 41. What questions do you have? MW Library web site http://mwlibrary.wordpress.com (or select Media Center on school’s home page) Navigation menus at top and on left MW Library bookmark account http://del.icio.us/dragonlibrary MW Library research wiki http://mwlibrary.wetpaint.com See Dig into the Deep Web
- 42. By brittanyg
- 43. References Dash, R. (2007, April 24). Exposing the invisible web to search engines. Search Engine Journal . Retrieved March 8, 2008, from http://www.searchenginejournal.com/exposing-the-invisible-web-to-search-engines/4771/ Deep web. (n.d.). Wikipedia . Retrieved March 8, 2008, from http://en.wikipedia.org/wiki/Deep_web He, B., Patel, M., Zhang, Z., & Chang, K. (2007). Accessing the deep web. Communications of the ACM 50 (5), 94-101. Retrieved March 8, 2008, from ACM Digital Library.