Difference between revisions of "Using Linux - Large Text Files"

From Computer Science
Jump to: navigation, search
(Large Text File)
(Large Text File)
 
(One intermediate revision by the same user not shown)
Line 12: Line 12:
 
cs299@cs:~> cd shakespeare
 
cs299@cs:~> cd shakespeare
 
</pre>
 
</pre>
Copy the text file from where it is stored on the CS server and use the wc command to see how many lines, words, and characters (bytes) are in the file.
+
Next we copy the text file from where it is stored on the CS server and use the wc command to see how many lines, words, and characters (bytes) are in the file.
 
<pre>
 
<pre>
 
cs299@cs:~/shakespeare> cp /u1/junk/shakespeare.txt .
 
cs299@cs:~/shakespeare> cp /u1/junk/shakespeare.txt .
Line 22: Line 22:
 
You can also use the nano text editor (or whatever text editor you like) to look through the text file.
 
You can also use the nano text editor (or whatever text editor you like) to look through the text file.
 
<pre>
 
<pre>
nano shakespeare.txt
+
cs299@cs:~/shakespeare> nano shakespeare.txt
 
</pre>
 
</pre>
 +
You can use the head and tail commands to look at the start and end of a text file, and grep to look for particular lines in the file.
 +
<pre>
 +
cs299@cs:~/shakespeare> head shakespeare.txt
 +
The Project Gutenberg EBook of The Complete Works of William Shakespeare, by
 +
William Shakespeare
  
* You can also watch a [video demo] of running the above commands.
+
This eBook is for the use of anyone anywhere at no cost and with
 +
almost no restrictions whatsoever.  You may copy it, give it away or
 +
re-use it under the terms of the Project Gutenberg License included
 +
with this eBook or online at www.gutenberg.org
 +
 
 +
** This is a COPYRIGHTED Project Gutenberg eBook, Details Below **
 +
**    Please follow the copyright guidelines in this file.    **
 +
cs299@cs:~/shakespeare> head -n 1 shakespeare.txt
 +
The Project Gutenberg EBook of The Complete Works of William Shakespeare, by
 +
cs299@cs:~/shakespeare> tail -n 1 shakespeare.txt
 +
*** END: FULL LICENSE ***
 +
cs299@cs:~/shakespeare> grep "Copyright" shakespeare.txt
 +
what you can do with this work.  Copyright laws in most countries are in
 +
cs299@cs:~/shakespeare> grep -i -m 3 "Copyright" shakespeare.txt
 +
** This is a COPYRIGHTED Project Gutenberg eBook, Details Below **
 +
**    Please follow the copyright guidelines in this file.     **
 +
*This Etext has certain copyright implications you should read!*
 +
</pre>

Latest revision as of 20:16, 13 January 2022

This page is a part of the Linux and CS Systems - Getting Started. This page assumes you have your computer setup to connect to the CS server, or have the appropriate software installed on your computer to run commands. Go back to the Linux and CS Systems Getting Started main page if you don't have our system setup yet.

Large Text File

On this page we walk you through looking at a text file that contains the complete works of Shakespeare (courtesy of Project Gutenberg). The file was downloaded from [1]. How many lines and words are there in this file? The file is a bit large to open with Word (you can try, it takes a while for it to actually load). So instead of opening the file in Word, we can use some of our Linux commands to get some information about the file. Check back at the Linux and CS Systems Getting Started page for more commands that might be useful.

The sample session here shows how you can copy the file into your account on the CS server and check how many lines and words are in the file. If you would like to follow along and run these commands, first login to the system and open up the terminal.

First, we create a directory in our home directory for keeping the shakespeare file.

cs299@cs:~> cd ~
cs299@cs:~> mkdir shakespeare
cs299@cs:~> cd shakespeare

Next we copy the text file from where it is stored on the CS server and use the wc command to see how many lines, words, and characters (bytes) are in the file.

cs299@cs:~/shakespeare> cp /u1/junk/shakespeare.txt .
cs299@cs:~/shakespeare> ls
shakespeare.txt
cs299@cs:~/shakespeare> wc shakespeare.txt 
 124787  904061 5589890 shakespeare.txt

You can also use the nano text editor (or whatever text editor you like) to look through the text file.

cs299@cs:~/shakespeare> nano shakespeare.txt

You can use the head and tail commands to look at the start and end of a text file, and grep to look for particular lines in the file.

cs299@cs:~/shakespeare> head shakespeare.txt
The Project Gutenberg EBook of The Complete Works of William Shakespeare, by
William Shakespeare

This eBook is for the use of anyone anywhere at no cost and with
almost no restrictions whatsoever.  You may copy it, give it away or
re-use it under the terms of the Project Gutenberg License included
with this eBook or online at www.gutenberg.org

** This is a COPYRIGHTED Project Gutenberg eBook, Details Below **
**     Please follow the copyright guidelines in this file.     **
cs299@cs:~/shakespeare> head -n 1 shakespeare.txt
The Project Gutenberg EBook of The Complete Works of William Shakespeare, by
cs299@cs:~/shakespeare> tail -n 1 shakespeare.txt
*** END: FULL LICENSE ***
cs299@cs:~/shakespeare> grep "Copyright" shakespeare.txt
what you can do with this work.  Copyright laws in most countries are in
cs299@cs:~/shakespeare> grep -i -m 3 "Copyright" shakespeare.txt 
** This is a COPYRIGHTED Project Gutenberg eBook, Details Below **
**     Please follow the copyright guidelines in this file.     **
*This Etext has certain copyright implications you should read!*