data-commons.github.io/index.html at master · data-commons/data-commons.github.io · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
<!DOCTYPE html>
<html>

  <head>
    <meta charset='utf-8'>
    <meta http-equiv="X-UA-Compatible" content="chrome=1">
    <meta name="description" content="Data Commons : Enabling working with data at scale">

    <link rel="stylesheet" type="text/css" media="screen" href="stylesheets/stylesheet.css">

    <title>Data Commons</title>
  </head>

  <body>

    <!-- HEADER -->
    <div id="header_wrap" class="outer">
        <header class="inner">
          <a id="forkme_banner" href="https://github.com/data-commons">View on GitHub</a>

          <h1 id="project_title">Data Commons</h1>
          <h2 id="project_tagline">Enabling working with data at scale</h2>

        </header>
    </div>

    <!-- MAIN CONTENT -->
    <div id="main_content_wrap" class="outer">
      <section id="main_content" class="inner">
        <h3>
<a id="the-data-commons-project" class="anchor" href="#the-data-commons-project" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a>The Data Commons Project</h3>

<p>Data commons community is a group of passionate data engineers and data scientists at ThoughtWorks. Our goal is to provide a collection of rich, high-performance libraries to automate various data processing tasks at scale. We are currently building these tools to work with Apache Spark platform.</p>

<h3>
<a id="active-projects" class="anchor" href="#active-projects" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a>Active Projects</h3>

<p>We are building a set of scalable, high-performance libraries that address an array of data processing concerns such as data quality assurance, data preparation for machine learning, data anonymization and data security. Here is a list of currently active projects </p>

<ul>
<li>
<a href="http://data-commons.github.io/prep-buddy"><strong>prep-buddy</strong></a> - A Scala / Java / Python library for cleansing, transforming and preparing large datasets for ML operations on Apache Spark.</li>
<li>
<a href="http://data-commons.github.io/protectr"><strong>protectr</strong></a> - A Scala / Java / Python library for anonymization, encryption and redaction operations for large datasets on Apache Spark.</li>
</ul>

<h3>
<a id="support-or-contact" class="anchor" href="#support-or-contact" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a>Support or Contact</h3>

<p>Catch up with us at our google group <a href="mailto:data-commons-toolchain@googlegroups.com">data-commons-toolchain@googlegroups.com</a></p>
      </section>
    </div>

    <!-- FOOTER  -->
    <div id="footer_wrap" class="outer">
      <footer class="inner">
        <p>Published with <a href="https://pages.github.com">GitHub Pages</a></p>
      </footer>
    </div>


  </body>
</html>