text analysis with Voyant Tools

text analysis with Voyant Tools

Posted by: on May 26, 2016   |Comments (0)|Digital Humanities

tl;dr: Voyant Tools is a free, open, web-based tool for textual analysis.

Voyant logoVoyant Tools is an open, web-based tool for textual analysis.  Using the tool is easy.  Go to the site and link to or upload your text (the system accepts a wide variety of formats including PDF, XML, TEI, and more).  Once you ingest the text or corpus you are presented with a dashboard of visualizations and tools.  Some of the tools built into Voyant include: Cirrus, a word cloud generator; Summary, a helpful overview of the corpus; Mandala, a visualization that shows the relationship between terms and documents; and many more (explore Voyant’s helpful documentation for the full list of tools).  Another great feature is the ability to generate a URL for the entire corpus dashboard or specific visualizations which can then be linked to or embedded into web-based writing.

Voyant Tools creators Stéfan Sinclar (@sgsinclair) and Geoffrey Rockwell (@GeoffRockwell) have also written a book called Hermeneutica: Computer-Assisted Interpretation in the Humanities (2016, MIT Press).  Rusty on your Greek and wondering what “hermeneutic” means, anyway?  So was I.  Hermeneutic means interpretive or explanatory and comes from the Greek “hermenēus,” interpreter.   The book is accompanied by an extremely rich and helpful web site, Hermeneuti.ca, that uses Voyant to visualize and interpret the book’s content while providing examples of how humanities scholars might integrate textual analysis visualizations into their writing.   One interesting example is found in Now Analyze That! in which speeches on the topic of race by Barack Obama and Jeremiah Wright are analyzed.

Text analysis has been part of the digital humanities toolkit for some time.  Voyant has been in existence since 2013 and several examples of how it has been used in digital pedagogy are available.  These include Brian Croxall’s (@briancroxall) discussion of using Voyant Tools to analyze Hemingway; an explanation of how Voyant Tools was used to analyze a corpus of runaway slave advertisements in the U.S. antebellum south as part of a digital history course at Rice University; and a recent write-up on ProfHacker.

I decided to play with Voyant Tools using the corpus of correspondence presented on our Dorr Letters Project site.  I zipped up all 61 TEI files, uploaded the zip file to Voyant Tools, and got this dashboard:

Voyant Dashboard

How cool!?  There is a lot to unpack in this data but I’ll highlight a couple of the things that most struck me:

  • the most used words in the corpus are: dorr, letter, constitution and state (I didn’t remove the TEI Header, introductory text, or follow-up questions included in our TEI so what shows up in the dashboard is not just representative of the letter content)
  • the second 30 letters in teh collection were written by “Anti-Dorrites.”  isolating that part of the corpus and then comparing it to those letters written by Dorr might be revealing
  • it would be interesting to select only those letters written by Dorr and analyze the frequency of certain terms to see if patterns arise over time in relation to Dorr’s political views (of course, this is a small corpus so broad generalizations are dangerous)

Voyant Tools is simple to use and extremely interesting- give it a try yourself!

tl;dr: Voyant Tools is a free, open, web-based tool for textual analysis. Voyant Tools is an open, web-based tool for... MORE

#ReCollectingRI: The Dorr Letters

Posted by: on November 9, 2015   |Comments (0)|Open Educational Resources

What does the past mean to you?  What comes to your mind when you think of Rhode Island history?  These questions are at the heart of the #ReCollectingRI project, an effort of the Rhode Island Historical Society to engage all Rhode Islanders with our past.

Here at the Phillips Memorial Library one of our digital collections presents a very interesting glimpse into Rhode Island history.  For that reason, we share our Dorr Letters to #ReCollectingRI.

2015-11-09_1013The Dorr Letters web site currently presents 60 letters written to and from Thomas Wilson Dorr around the time of the Dorr Rebellion in 1842.  The letters present an important glimpse into how this critical event unfolded.  You can view the original manuscripts on the site, or read their transcriptions.  The site also provides contextual information about many of the important peoples and places that show up in the letters.

For more on #ReCollectingRI visit: http://www.rihs.org/recollectingri/ or check out the the hashtag on Facebook and TwitterWhat will you add?

 

What does the past mean to you?  What comes to your mind when you think of Rhode Island history?  These... MORE

Historical Pamphlets Added to the Dorr Rebellion Site

Posted by: on April 28, 2015   |Comments (0)|Digital Publishing

Digital Publishing Services recently added 16 pamphletsScreen Shot 2015-04-28 at 10.03.11 AM to the Dorr Rebellion website titled: Pamphlets: Contemporary Assessments of the Dorr Rebellion.  From the site:

Learn more about what contemporaries of the Dorr Rebellion thought about the conflict by exploring these 16 pamphlets written during or shortly after the rebellion took place.

 

One great example is “An Address on the Right of Free Suffrage'” written by Seth Luther, an antebellum workers’ and suffrage organizer from Providence, RI.  In this pamphlet, Luther speaks at length about the discrepancies surrounding the rights of free men in this still young government and it’s constitution.

This material adds an important additional layer of complexity to the Dorr site.  It allows readers to explore what those for and against the Dorr Rebellion were writing before, during and shortly after it took place.

Digital Publishing Services recently added 16 pamphlets to the Dorr Rebellion website titled: Pamphlets: Contemporary Assessments of the Dorr Rebellion.... MORE

Spotlight: Dorr Rebellion Site Constitutions

Posted by: on April 2, 2015   |Comments (0)|Spotlights

2Featured on the Dorr Rebellion website is a Constitutions module. This section features links to PDFs of The People’s Constitution, Law & Order Constitution, and a side by side comparison of the two. The PDFs are readable online (or available for download) as searchable documents or available for examination in a page viewer that has the option of automatic or manual page turning. Each constitution’s page has on it a detailed summary of information relevant to it, written by Dr. Patrick T. Conley, constitutional historian and co-author of The Rhode Island State Constitution: A Reference Guide (2010). An article-by-article comparison is also available on the main Constitutions page. You can view this section of the site here.

Featured on the Dorr Rebellion website is a Constitutions module. This section features links to PDFs of The People’s Constitution, Law... MORE

Dorr Rebellion Lesson Plans

Posted by: on August 6, 2014   |Comments (0)|Open Educational Resources

Did you know that in addition to the documentary, the gallery, and the letters, the Dorr Rebellion Project web site also contains five lesson plans for use in the high school or post-secondary classroom?

The plans can be used independently or combined to form a unit on the Dorr Rebellion.  The lessons cover the following topics:

dorr lesson plans

Each lesson plan is aligned with specific Rhode Island Grade Span Expectations (GSEs) for Civics and Social Studies.  All of the lessons require that students to engage with primary source material hosted on the Dorr Rebellion web site.

In May the lesson plans were shared with local K-12 teachers at the RI Social Studies Institute.  Both the lesson plans and the web site generated a lot of enthusiasm from middle and high school teachers.

If you use the lesson plans and have feedback we’d love to hear from you.  You can comment here or email dps@providence.edu.  Happy teaching!

Did you know that in addition to the documentary, the gallery, and the letters, the Dorr Rebellion Project web site... MORE

30 more letters! Working facets! It’s another Dorr Letters site update!

Posted by: on June 25, 2014   |Comments (0)|Digital Publishing

Untitled

 

 

Hello everyone!

I’ve got some great news for those who have been following the Dorr Letters site project. We’ve just finalized the encoding for 30 more letters, uploaded them to the Dorr Letters site, and updated some of the code to allow for faceting not only by date, but now by collection and author!

We’ve added more entries for the contextual “ography” popup content, and squashed a bunch of bugs and glitches!

Check out the new updates here: http://library.providence.edu:8080/xtf/index.xml

Per usual, we are not done with the site. Stay tuned for an updated home page that will be more user friendly and will make more sense of the different Dorr Letter collections!

    Hello everyone! I’ve got some great news for those who have been following the Dorr Letters site project.... MORE

Dorr Letters site, big update!

Posted by: on January 17, 2014   |Comments (0)|Digital Publishing

twd1_preview

Do you remember awhile back we posted a sneak peek at some of the upcoming features of the Dorr Letters site? If you don’t, no worries, check it out here. Well, we have finally gone live with those changes!

The Dorr Letters project site now includes:

  • Contextual, informative popups for most persons, places, and organizations within the letters
  • Working date facets, you can now filter letters by the date they were written
  • Working formatting templates, the plain text now mirrors some of the formatting of the actual letters.

Go to the Dorr Letters project site, and check out the updates!

Do you remember awhile back we posted a sneak peek at some of the upcoming features of the Dorr Letters... MORE

Dorr Letters Site: Update In The Works

Posted by: on October 16, 2013   |Comments (0)|Digital Publishing

Dorr Popups

The Dorr Letters site will be looking a bit differently in the coming weeks. We’ve been at work creating and implementing some new content that will be weaved into each letter. The goal is to allow users the ability to click on the name of a person, place, or organization and be served a quick morsel of information about that person/place/organization. We’re currently working on setting up this workflow for all three information types as well as filling out the content behind the curtains so that none of the popups come up empty!

We took a bit of inspiration from the Colonial Despatches website created by the Humanities Computing and Media Centre, University of Victoria:

Check out their work here: http://bcgenesis.uvic.ca/index.htm

The Dorr Letters site will be looking a bit differently in the coming weeks. We’ve been at work creating and... MORE

Dorr Rebellion Project Site Highlighted in The Junto

Posted by: on October 10, 2013   |Comments (0)|Open Educational Resources

Providence College’s Dr. Erik Chaput (’03, ’05G and faculty in the School of Continuing Education) and Mr. Russell DeSimone (’67, local historian and collector) recently posted about the Dorr Rebellion Project Site on the early Americanists blog, The Junto. Dr. Chaput and Mr. DeSimone provide beautifully written, content-rich historical context leading up to and surrounding “the constitutional crisis that erupted in Rhode Island in 1841-1842.” The Dorr Rebellion Project Site is the resulting collaboration of the Phillips Memorial Library+Commons (Providence College), Dr. Erik Chaput and Mr. Russell DeSimone.

Junto

View Dr. Chaput and Mr. DeSimone’s post here.

Providence College’s Dr. Erik Chaput (’03, ’05G and faculty in the School of Continuing Education) and Mr. Russell DeSimone (’67,... MORE

Dorr Rebellion site update!

Posted by: on August 21, 2013   |Comments (0)|Digital Publishing

Thomas Wilson Dorr

Hello all!

I had mentioned awhile back that the Dorr Rebellion site would be getting a bit of a facelift. Well, after a few meetings and some brainstorming, I present, the new, updated Dorr Rebellion site! The architecture has been optimized to highlight some of the newer Dorr Rebellion project developments and we’ve added a cleaner solution for the videos in the gallery as well as a dynamically generated updates page!

Check it out!

Hello all! I had mentioned awhile back that the Dorr Rebellion site would be getting a bit of a facelift.... MORE