Beginner's Guide to Computation in Statistical Research - Revision history

Areinhar: use a grid of boxes instead of a sequence

2026-07-07T14:18:01Z

use a grid of boxes instead of a sequence

← Older revision		Revision as of 14:18, 7 July 2026
Line 4:		Line 4:
	Your first goal is to translate mathematical algorithms into functional code. '''It is important to familiarize yourself with these concepts early on.'''		Your first goal is to translate mathematical algorithms into functional code. '''It is important to familiarize yourself with these concepts early on.'''

			<div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(500px, 1fr))">
	<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">		<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
	'''[[Choosing and Installing a Programming Language]]''' <br>		'''[[Choosing and Installing a Programming Language]]''' <br>
Line 22:		Line 23:
	'''[[Command Line Basics]]''' <br>		'''[[Command Line Basics]]''' <br>
	Essential survival skills for navigating your computer without graphical windows		Essential survival skills for navigating your computer without graphical windows
			</div>
	</div>		</div>
	#		#
Line 28:		Line 30:
	Once you have gotten the hang of implementing statistical algorithms in code, the next major hurdle will be making your workflows '''scalable and efficient'''. For code running on your own machine, you want to make sure you are using every CPU core and every bit of RAM as efficiently as possible. Even then, your personal computer alone can only get you so far. Thankfully, the department also provides several options for remote high-performance computing for even the largest of research workflows.		Once you have gotten the hang of implementing statistical algorithms in code, the next major hurdle will be making your workflows '''scalable and efficient'''. For code running on your own machine, you want to make sure you are using every CPU core and every bit of RAM as efficiently as possible. Even then, your personal computer alone can only get you so far. Thankfully, the department also provides several options for remote high-performance computing for even the largest of research workflows.

			<div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(500px, 1fr))">
	<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">		<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
	'''[[Building Workflows on Remote Servers]]''' <br>		'''[[Building Workflows on Remote Servers]]''' <br>
Line 41:		Line 44:
	'''[[Big Data Management]]''' <br>		'''[[Big Data Management]]''' <br>
	How to handle datasets that are measured in terabytes		How to handle datasets that are measured in terabytes
			</div>

	</div>		</div>

Line 46:		Line 51:
	While it is important that you are able to obtain results efficiently, it is also equally important for other members of the academic community to arrive at your same results independently. Specifically, others should be able to run your workflow and obtain the exact same output as you did with minimal tinkering and friction.		While it is important that you are able to obtain results efficiently, it is also equally important for other members of the academic community to arrive at your same results independently. Specifically, others should be able to run your workflow and obtain the exact same output as you did with minimal tinkering and friction.

			<div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(500px, 1fr))">
	<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">		<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
	'''[[Version Control]]''' <br>		'''[[Version Control]]''' <br>
Line 54:		Line 60:
	'''[[Dependency Management]]''' <br>		'''[[Dependency Management]]''' <br>
	Making sure anyone else in the world can run your workflow		Making sure anyone else in the world can run your workflow
			</div>

	</div>		</div>

Line 59:		Line 67:
	If you envision yourself making your methods and associated algorithms available for mass adoption, there are other considerations for publishing your code that go beyond simple reproduciblity. Other should not only be able to reproduce your results, but also modify your code for new experiments with minimal hassle.		If you envision yourself making your methods and associated algorithms available for mass adoption, there are other considerations for publishing your code that go beyond simple reproduciblity. Other should not only be able to reproduce your results, but also modify your code for new experiments with minimal hassle.

			<div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(500px, 1fr))">
	<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">		<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
	'''[[Creating Libraries and Packages]]''' <br>		'''[[Creating Libraries and Packages]]''' <br>
Line 67:		Line 76:
	'''[[Working with package repositories]] (TBW)''' <br>		'''[[Working with package repositories]] (TBW)''' <br>
	How to upload your packages to public repositories for easy widespread distribution.		How to upload your packages to public repositories for easy widespread distribution.
			</div>

	</div>		</div>

Ajshen at 03:41, 30 June 2026

2026-06-30T03:41:26Z

← Older revision		Revision as of 03:41, 30 June 2026
Line 1:		Line 1:
	At some point, you will need to demonstrate that your statistical methods actually work in practice. Whether you are running a toy simulation, analyzing real-world data, or optimizing a complex neural network, you will need to write code. If you are new to computing, the wiki can be overwhelming. '''Read ~~this page from~~ top to bottom up through the Reproducibility and Collaboration section.''' It is designed to take you from installing your first language to running massive workflows on department servers.		At some point, you will need to demonstrate that your statistical methods actually work in practice. Whether you are running a toy simulation, analyzing real-world data, or optimizing a complex neural network, you will need to write code. If you are new to computing, the wiki can be overwhelming. '''Read every section top to bottom up through the Reproducibility and Collaboration section. (You do not need to read every page in every section, but note their existence)''' It is designed to take you from installing your first language to running massive workflows on department servers.

	== Implementation ==		== Implementation ==

Ajshen: /* Software Development (Optional) */

2026-06-28T20:47:03Z

Software Development (Optional)

← Older revision		Revision as of 20:47, 28 June 2026
Line 57:		Line 57:

	== Software Development (Optional) ==		== Software Development (Optional) ==
	If you envision yourself making your methods and associated algorithms available for mass adoption, there are other considerations for publishing your code that go beyond simple reproduciblity. Other should not only be able to reproduce your results, but also modify your code for new experiments with minimal hassle.<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">		If you envision yourself making your methods and associated algorithms available for mass adoption, there are other considerations for publishing your code that go beyond simple reproduciblity. Other should not only be able to reproduce your results, but also modify your code for new experiments with minimal hassle.

			<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
	'''[[Creating Libraries and Packages]]''' <br>		'''[[Creating Libraries and Packages]]''' <br>
	How to structure your code to for easy widespread distribution		How to structure your code to for easy consumption by other researchers
			</div>

			<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
			'''[[Working with package repositories]] (TBW)''' <br>
			How to upload your packages to public repositories for easy widespread distribution.
	</div>		</div>

Ajshen: /* Software Development (Optional) */

2026-06-28T20:44:02Z

Software Development (Optional)

← Older revision		Revision as of 20:44, 28 June 2026
Line 59:		Line 59:
	If you envision yourself making your methods and associated algorithms available for mass adoption, there are other considerations for publishing your code that go beyond simple reproduciblity. Other should not only be able to reproduce your results, but also modify your code for new experiments with minimal hassle.<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">		If you envision yourself making your methods and associated algorithms available for mass adoption, there are other considerations for publishing your code that go beyond simple reproduciblity. Other should not only be able to reproduce your results, but also modify your code for new experiments with minimal hassle.<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
	'''[[Creating Libraries and Packages]]''' <br>		'''[[Creating Libraries and Packages]]''' <br>
	~~Developing Python and R packages~~ for ~~wider~~ distribution		How to structure your code to for easy widespread distribution
	</div>		</div>

Ajshen: /* Software Development */

2026-06-27T06:31:00Z

Software Development

← Older revision		Revision as of 06:31, 27 June 2026
Line 56:		Line 56:
	</div>		</div>

	== Software Development ==		== Software Development (Optional) ==
	<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">		If you envision yourself making your methods and associated algorithms available for mass adoption, there are other considerations for publishing your code that go beyond simple reproduciblity. Other should not only be able to reproduce your results, but also modify your code for new experiments with minimal hassle.<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
	'''[[Creating Libraries and Packages]]''' <br>		'''[[Creating Libraries and Packages]]''' <br>
	Developing Python and R packages for wider distribution		Developing Python and R packages for wider distribution
	</div>		</div>

Ajshen: /* Reproducibility and Collaboration */

2026-06-27T06:28:32Z

Reproducibility and Collaboration

← Older revision		Revision as of 06:28, 27 June 2026
Line 43:		Line 43:
	</div>		</div>

	==Reproducibility and Collaboration==		== Reproducibility and Collaboration ==
	While it is important that you are able to obtain results efficiently, it is also equally important for other ~~member~~ of the academic community to arrive at your same results independently. Specifically, others should be able to run your workflow and obtain the exact same output as you did with minimal tinkering and friction.		While it is important that you are able to obtain results efficiently, it is also equally important for other members of the academic community to arrive at your same results independently. Specifically, others should be able to run your workflow and obtain the exact same output as you did with minimal tinkering and friction.
	~~{\| class~~="~~wikitable~~"
	~~!Title~~		<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
	~~!Description~~		'''[[Version Control]]''' <br>
	~~!Reading Time?~~		Keeping track of code/experiment history
	\|-		</div>
	\|[[Version Control]]
	\|Keeping track of code/experiment history		<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
	\|		'''[[Dependency Management]]''' <br>
	\|-		Making sure anyone else in the world can run your workflow
	\|[[Dependency Management]]		</div>
	\|Making sure anyone else in the world can run your workflow
	\|
	\|}
	#

	== Software Development ==		== Software Development ==

Ajshen: /* Software Development */

2026-06-27T06:28:20Z

Software Development

← Older revision		Revision as of 06:28, 27 June 2026
Line 60:		Line 60:
	#		#

	==Software Development==		== Software Development ==
	~~Topics like~~		<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
			'''[[Creating Libraries and Packages]]''' <br>
	*[[~~Developing python packages~~]] and ~~[[Developing~~ R packages]]		Developing Python and R packages for wider distribution
			</div>

Ajshen at 06:22, 27 June 2026

2026-06-27T06:22:43Z

← Older revision		Revision as of 06:22, 27 June 2026
Line 1:		Line 1:
	At some point, you will need to demonstrate that your statistical methods actually work in practice. Whether you are running a toy simulation, analyzing real-world data, or optimizing a complex neural network, you will need to write code. If you are new to computing, the wiki can be overwhelming. '''Read this page from top to bottom.''' It is designed to take you from installing your first language to running massive workflows on department servers.		At some point, you will need to demonstrate that your statistical methods actually work in practice. Whether you are running a toy simulation, analyzing real-world data, or optimizing a complex neural network, you will need to write code. If you are new to computing, the wiki can be overwhelming. '''Read this page from top to bottom up through the Reproducibility and Collaboration section.''' It is designed to take you from installing your first language to running massive workflows on department servers.

	== Implementation ==		== Implementation ==

Ajshen: /* Scale and Efficiency */

2026-06-27T05:31:45Z

Scale and Efficiency

← Older revision		Revision as of 05:31, 27 June 2026
Line 29:		Line 29:

	<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">		<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
	'''[[~~Parallelization: Making the most of your Machine~~]]''' <br>		'''[[Building Workflows on Remote Servers]]''' <br>
	~~How to run multiple experiments simultaneously without babysitting your machine~~		Using the department servers and other computing clusters
	</div>		</div>

	<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">		<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
	'''[[~~Building Workflows on Remote Servers~~]]''' <br>		'''[[Parallelization: Making the most of your Machine]]''' <br>
	~~Using the department servers and other computing clusters~~		How to run multiple experiments simultaneously without babysitting your machine
	</div>		</div>

Ajshen: /* Scale and Efficiency */

2026-06-26T04:15:04Z

Scale and Efficiency

← Older revision		Revision as of 04:15, 26 June 2026
Line 30:		Line 30:
	<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">		<div style="background-color: #f8f9fa; border-left: 4px solid #C41230; padding: 10px 15px; margin-bottom: 10px;">
	'''[[Parallelization: Making the most of your Machine]]''' <br>		'''[[Parallelization: Making the most of your Machine]]''' <br>
	How to run multiple experiments simultaneously without babysitting your machine.		How to run multiple experiments simultaneously without babysitting your machine
	</div>		</div>