Additional Programs to Install
- Compression - for those using Windows, install 7-Zip. MacOS and Linux natively support most compression formats that we will need.
- R - first install R and then install RStudio Desktop (free).
- Teams - ISU faculty/staff/students can install MS Teams for free along with other parts of Office 365. Start by logging into https://portal.office.com with your ISU credentials, click around looking for Teams (may have to click on "All Apps" or something like that), and once you get to Teams look for a link to download the desktop application (for Windows and Mac OS, not available for Linux). You can also use Teams in the browser.
- Login to https://gitlab.indstate.edu so you can be added onto projects there.
Potentially good things to read / tutorials, etc. ...
- R: R Programming - Getting Started - programs to install, reading, etc.
- Other courses like this one - Introduction to Computational & Quantitative Biology - Columbia Dept Microbiology & Immunology,
In particular, your assigned reading includes...
- From the R Programming Getting Started, start looking through each of the items linked in Reading
- UCSD lecture 17 - Transcriptomics and the analysis of RNA-Seq data
- Up through Figure 1 in Genome-Wide Temporal Profiling of Transcriptome and Open-Chromatin of Early Cardiomyocyte Differentiation Derived From hiPSCs and hESCs
- Columbia - check each of the lectures to see what is basically there, and refer back to it when we get to those parts. These lecture slides are very much at a level that is good for what we are doing.
- SVM slides in Unit 6 from UT Dallas https://personal.utdallas.edu/~prr105020/biol6385/2018/lecture.html
- Dummy Variables in SVM / KNN
- Machine Learning with caret in R
- Decision trees in R (datacamp), Random forests (towards data science)
- Jeff's notes on terms, etc.
Start by watching the video introduction (16min, watch it at 2x or 1.5x).
On your own computer, download the dataset and extract (uncompress) the file (on MacOS or Linux just double click it, on Windows use 7-Zip or something similar).
After extracting you can open the file in Excel, Sheets, or LibreOffice. Note that it is a tsv file. If you double click, your OS may not know what program to use to open it. So start your spreadsheet program and then open the file. Some things are not too painful to do in your spreadsheet program. For example, you should verify that the following are all correct...
- Genes with highest H1_day0_0 values: SNORD97, SNHG25, EEF1A1, RPL38, RPS27.
- Genes with highest H1_CM_0 values: H19, MYL7, RPL31, SNORD9, RPS27.
- Number of genes (#rows - 1): 26257
- Median value for H1_day0_0: 0.539942
- Median value for H1_CM_0: 1.246015
- Average value for H1_day0_0: 15.86772859
- Average value for H1_CM_0: 16.4574767
It seems that this dataset might be normalized so that the average values for each column (sample) are similar.
And that is about all we want to do in the spreadsheet right now. You can save it as an xlsx or import into Google Sheets in case we want to do anything else manually with it.
R and R Studio
Start by watching the video about gse85331_first_look.R (18min).
First Look Let's see what we can do with the same file in R and R Studio. First you should install R and R Studio on your computer, see links above. Let's take a first look at the data and confirm the values we got from Excel. You can download the R file here - gse85331_first_look.R and run it to confirm this. See also this video showing the file and explaining it.
Differential expression From the supplementary information from the publication, differentially expressed genes were found as follows - "Statistical analysis was performed for each cell line individually by pairwise comparisons across time-points and day 0 (control)." So, let's see if we can duplicate that. You can download the R file here - gse85331_diff_exp.R and run it to see one way to do this. See also this video showing the file and explaining it.
Simulated data Taking the previous analysis from above and putting in simulated data where we know what the answer should be for each gene. You can download the R file here - gse85331_diff_exp_simulated.R and run it yourself. See also this video showing the file and explaining it.
Next up - Using an R package specifically made for differential gene expression (DESeq and edgeR) and comparing with using plain old ANOVA.
An R file showing how to get started with shape files - shapefiles.R
The data files for those are in the Teams for CS 618 / Papers, References / Files / Shapefiles
Note that a shapefile often has a number of associated files with it (same basename, different file extension). You likely need all of those for things to work properly.
Things that will be put somewhere else eventually, but for now will be here.
Setup for using gitlab.indstate.edu from the CS server, Linux, or Mac
- Go to https://gitlab.indstate.edu and login with your ISU credentials.
- Run the following.
mkdir ~/.ssh # unless it exists already cd ~/.ssh ssh-keygen -t ecdsa -f filename_for_your_ssh_key # pick whatever you want for the filename, press enter when prompted for passphrase
- Edit your
~/.ssh/confifile (creating it if it doesn't exist already), and include the following.
Host gitlab.indstate.edu Hostname gitlab.indstate.edu IdentityFile ~/.ssh/filename_for_your_ssh_key # or whatever you used for the filename* Take the public key file (filename_for_your_ssh_key.pub, or whatever you used for the filename with .pub on the end) and add it to your profile on gitlab.indstate.edu. Login to gitlab.indstate.edu, click the User icon in top right / Edit Profile / SSH Keys. Copy/paste the public key (.pub file) into the text field, leave “expires at” empty, set a title to something, click Add key. Now when you use git commands on the system that you setup like this, it should properly authenticate to gitlab.indstate.edu.