Commits · master · Courseware / Oak-Tree Engineering Courseware / DataOps Examples

24 May, 2022 2 commits
- Merge branch 'roakes/spark321-k8s-r1' into 'master' · 7c177d45
  Brandon Harper authored May 24, 2022
```
Bugfixes needed for 2022-05 analytics images (Sonador AI / MONAI/ PyTorch)

See merge request !9
```
  7c177d45
- Bugfixes needed for 2022-05 analytics images (Sonador AI / MONAI/ PyTorch) · d8bf992d
  Rob Oakes authored May 24, 2022
  
  d8bf992d
18 May, 2022 2 commits
- Merge branch 'roakes/dev.spark321' into 'master' · 786d1fca
  Brandon Harper authored May 18, 2022
```
Updates to Root analytics images for Q1 2022

See merge request !8
```
  786d1fca
- Updates to Root analytics images for Q1 2022 · 90da8336
  Rob Oakes authored May 18, 2022
  
  90da8336
13 Aug, 2021 1 commit

Merge branch 'roakes/spark312-k8s' into 'master' · a8b92e94

Rob Oakes authored Aug 13, 2021

Updates to Spark Images: Spark 3.1.2, upgraded data science packages to newest versions.

See merge request !7

a8b92e94

20 Jun, 2021 1 commit
- Updates to Spark Images: Spark 3.1.2, upgraded data science packages to newest versions. · 44cbd1df
  Rob Oakes authored Jun 19, 2021
  
  44cbd1df
18 Feb, 2021 2 commits
- Merge branch 'roakes/spark301-k8s' into 'master' · b9c68278
  Ethan Chapman authored Feb 18, 2021
```
Updates to Root images to include 3D tools and libraries for Sonador AI/3D work

See merge request !5
```
  b9c68278
- Updates and refactors to JupyterHub and other Docker containers · 6d598f59
  Rob Oakes authored Feb 18, 2021
```
- Pin JupyterLab version to 2.2.x, as many of the extensions do not
  support 3.x
```
  6d598f59
30 Dec, 2020 1 commit
- Syntax fix in README.md · 041f3a8d
  Ethan Chapman authored Dec 30, 2020
  
  041f3a8d
14 Nov, 2020 1 commit
- Merge branch 'roakes/spark301-k8s' into 'master' · e1bda034
  Rob Oakes authored Nov 14, 2020
```
Added a "deep learning" image with TensorFlow, CUDA, and PyTorch

See merge request !4
```
  e1bda034
11 Nov, 2020 3 commits
- Clarified what Dask does in README · beada1bb
  Rob Oakes authored Nov 11, 2020
  
  beada1bb
- Added Dask image to stack, modified ITK to inherit from Dask · 2c1fa41f
  Rob Oakes authored Nov 11, 2020
  
  2c1fa41f
- Moved deep learning and CUDA libraries to a separate Dockerfile · b06bf368
  Rob Oakes authored Nov 11, 2020
```
- Re-arranged image stacking so that DL layer appears before
  the Jupyter polyglot image. (So that R and Python libraries
  can use TensorFlow and PyTorch.)
- Pinned TensorFlow and PyTorch versions to those compatible
  with CUDA 11.
```
  b06bf368
28 Sep, 2020 2 commits
- Merge branch 'roakes/dev.spark301' into 'master' · 748bce8d
  Rob Oakes authored Sep 28, 2020
```
Update Root container images to Spark 3

See merge request !3
```
  748bce8d
- Added PyTorch3D and Octave to the environment · ebccd13a
  Rob Oakes authored Sep 28, 2020
  
  ebccd13a
27 Sep, 2020 2 commits
- Upgraded Docker image stack to Spark 3 and Ubuntu 20.04 · bbc44da6
  Rob Oakes authored Sep 27, 2020
```
- Updated to Spark 3
- Upgraded JupyterLab to 2.x
- Added GIMP and OpenCV for image processing
- Incorporated Sonador client
```
  bbc44da6
- Removed obsolete images, since Spark 3 supports S3/MinIO natively · 16a719d4
  Rob Oakes authored Sep 27, 2020
  
  16a719d4
04 May, 2020 2 commits
- Added addition to the LD path to allow for OpenCASCADE lookup · e3ab0982
  Oak-Tree Administrator authored May 04, 2020
  
  e3ab0982
- First pass incorporation of OpenCASCADE for reading/writing JT files · e112fec0
  Oak-Tree Administrator authored May 04, 2020
  
  e112fec0
01 May, 2020 2 commits
- Merge branch 'spark245-k8s' of... · a92f377c
  Centerville Oak-Tree Administrator authored May 01, 2020
```
Merge branch 'spark245-k8s' of https://code.oak-tree.tech/courseware/oak-tree/dataops-examples into spark245-k8s
```
  a92f377c
- Added install of OpenCASCADE libraries · 20e9805d
  Centerville Oak-Tree Administrator authored May 01, 2020
  
  20e9805d
03 Apr, 2020 2 commits
- Added VTK to the set of tools in the ITK container · 08d76ec7
  Oak-Tree Administrator authored Apr 03, 2020
  
  08d76ec7
- Updated Spark containers to JupyterLab 2.0, added ITK container · 1c7820d6
  Rob Oakes authored Apr 03, 2020
  
  1c7820d6
10 Mar, 2020 2 commits
- Modified Kubernetes image to use OpenJDK 8, but also install 11 · d76e6e30
  Rob Oakes authored Mar 10, 2020
  
  d76e6e30
- Merge branch 'master' of... · 2c62abdc
  Rob Oakes authored Mar 10, 2020
```
Merge branch 'master' of https://code.oak-tree.tech/courseware/oak-tree/dataops-examples into spark245-k8s
```
  2c62abdc
28 Feb, 2020 1 commit
- Added jupyter-server-proxy · bc9ead92
  Rob Oakes authored Feb 28, 2020
  
  bc9ead92
27 Feb, 2020 3 commits
- Merge branch 'spark245-k8s' into 'master' · 23488df6
  Rob Oakes authored Feb 27, 2020
```
Update all images to utilize Spark 2.4.5

See merge request !2
```
  23488df6
- Update all images to utilize Spark 2.4.5 · d8d688e3
  Rob Oakes authored Feb 27, 2020
  
  d8d688e3
- Modified the procedure to utilize the Spark 2.4.5 images · e5338a27
  Rob Oakes authored Feb 27, 2020
  
  e5338a27
26 Feb, 2020 4 commits
- Upgraded OpenJDK to 11, Spark to 2.4.5 · e14c4ee1
  Rob Oakes authored Feb 26, 2020
  
  e14c4ee1
- Added Maven to the Java toolset · 91825e56
  Rob Oakes authored Feb 26, 2020
  
  91825e56
- Added "hub-poly" example · d484076c
  Rob Oakes authored Feb 26, 2020
  
  d484076c
- Added vim text editor and sudo to Jupyter image · 9cf5fe50
  Rob Oakes authored Feb 26, 2020
  
  9cf5fe50
25 Jan, 2020 1 commit
- Added PyTorch to JupyterHub Docker · 0596d613
  Rob Oakes authored Jan 25, 2020
  
  0596d613
29 Dec, 2019 5 commits
- Merge branch 'master' of https://code.oak-tree.tech/courseware/oak-tree/dataops-examples · 2aad8f13
  Rob Oakes authored Dec 29, 2019
  
  2aad8f13
- Added PyTorch and NLP libraries, s3fs as a wrapper for boto · 8648529b
  Rob Oakes authored Dec 29, 2019
  
  8648529b
- Added Dockerfile for the Spark ML executor image · 25e792ff
  Rob Oakes authored Dec 29, 2019
  
  25e792ff
- Merge branch 'roakes/k8s-spark' into 'master' · b29a0fc2
  Rob Oakes authored Dec 29, 2019
```
Dockerfile resources for creating Docker based Spark images that can be used in AWS and self-hosted K8s

See merge request !1
```
  b29a0fc2
- Dockerfile resources for creating Docker based Spark images that can be used... · d4e2d816
  Rob Oakes authored Dec 29, 2019
```
Dockerfile resources for creating Docker based Spark images that can be used in AWS and self-hosted K8s
```
  d4e2d816
16 Dec, 2019 1 commit
- Added wordcount.java for students to apply easy input · 00e0a685
  Brandon Harper authored Dec 16, 2019
  
  00e0a685