Skip to content

Latest commit

 

History

History
222 lines (186 loc) · 12.6 KB

assessment.md

File metadata and controls

222 lines (186 loc) · 12.6 KB

Assessment for Candidates

This is an assessment we use to see what your level of aptitude is with industry tools that are freely available on the internet. We send this assessment to candidates we feel are good at the basic knowledge and are able to communicate. The goal is to see how you can use existing documentation to achieve this or to figure something out. A big part of our company's work is to learn new tools, teach it internally, and communicate it to clients.

What we're looking for is how well you reviewed the links, did additional research as needed, and how far you were able to go. Pick one track and let us know how far you get in 24-48 hours. You can take longer but we are making decisions soon so we're looking for folks who can quickly get started with instructions like this and start to figure things out.

  • Data & Analytics / Batch Platform Data Engineering @Anant.us

    • Demonstrate basic knowledge of dev ops tooling
      • Bring up DSE on Docker
      • Demonstrate working DSE OpsCenter Front End
      • Demonstrate working DSE Studio Front End w/ Spark, SparkSQL, Graph
      • Demonstrate working CQLSH/Nodetool commands in Docker exec
    • Demonstrate knowledge of using basic Spark to Import Data
      • Find a data set online or use Datastax Examples
      • Create a schema of use Datastax Example schema
      • Create a Spark Script (Python or Scala) OR Spark Job to import data into DSE
    • Demonstrate knowledge of using basic Spark or SparkSQL to get counts
      • Using imported data set show how to use Spark to do basic aggregations/ filtering
      • Can use Spark or Spark SQL
    • Demonstrate knowledge of using an external tool to use CQL and SQL
    • Demonstrate advanced knowledge of Spark Streaming on cloud Spark Platform
      • Create an account on a Public Cloud that offers a ready to go Spark instance for free.
        • Amazon EMR
        • Databricks Community
        • Google Cloud
      • Consume a public stream from the internet via Spark Streaming and persist it. If you can’t find it create random data using faker libraries.
        • Distributed DB
          • Amazon MCS
          • Azure Cosmos DB
          • Cassandra on Docker
          • Datastax Cloud
        • Distributed File Systems
          • S3
          • Azure Blob
          • GFS
      • Create a batch process that analyzes the data and creates a report / or visualization.
        • Descriptive
          • Aggregate SQL queries on information
          • Histograms
          • Time Series Visualization
        • Predictive
          • Classification
          • Regression
          • Sentiment Analysis
      • Deliver data
        • Notebook Interface
        • API
        • Visualization
  • Data & Analytics / Streaming Platform Data Engineering @Anant.us

  • Demonstrate knowledge of distributed data systems

  • Demonstrate knowledge of data streaming platforms

    • Work with DataStax Astra Streaming
      • Create Astra Streaming (Pulsar) topics and write a simple producer and consumer.
      • Connect to Astra Streaming (Pulsar) using Kafka producer / consumer.
  • Advanced: Build a data pipeline

    • Integrate AstraDB to Astra Streaming
      • Create a CDC Connector from AstraDB (Cassandra) Table 1 to a Astra Streaming (Pulsar) Topic 1
      • Create a data producer that adds data to the Table 1, so data comes into the Topic 1
      • Create a Pulsar Function that performs an aggregation, or an enhancement on data in Topic 1 and saves it to Topic 2
      • Connect Topic 2 to save data to AstraDB (Cassandra) Table 2
  • Data & Analytics / Platform Operator @Anant.us

    • Demonstrate knowledge of cloud services and infrastructure with modular infrastructure as code
      • Utilize AWS, Azure, or GCP to deploy data services.
      • Set up instances using Terraform
        • Create a jumpbox/ bastion node
        • Create a set of 3 virtual machines with public and private IPs
        • Protect the public IP with firewall rules to only applicable rules for the application you are hosting
    • Demonstrate basic knowledge of configuration management
      • Using ansible, deploy a distributed application of your choice.
        • Apache Cassandra / Datastax
        • Apache Kafka / Confluent
        • Apache Spark
      • Using ansible, deploy monitoring stack of your choice.
        • ELK / BEK Stack
        • Prometheus / Grafana
    • Run a basic load on the distributed platform
      • Using a load generator create traffic / load on the platform
      • Show how load is distributed evenly / unevenly on platform
  • Data & Analytics / Generative AI / LLM Engineering @Anant.ai

  • Demonstrate knowledge of vector databases

  • Demonstrate knowledge of AI frameworks

  • Advanced: Build an AI-powered application

    • Combine vector databases and LLMs.
      • Create a semantic search application.
      • Implement a chatbot that provides context-aware responses.
  • Demonstrate LLM fine-tuning

    • Fine-tune a language model for a specific task.
      • Use OpenAI or other cloud LLM Service
      • Document the fine-tuning process and results.
    • Advanced: Fine-tune a language model for a specific task.
      • Use open-source models compatible with your hardware.
      • Document the fine-tuning process and results.

Customer Experience / No-Code Platform Engineer @Appleseed.works

  • Demonstrate knowledge of no-code platforms

  • Integrate backend services

  • Incorporate Gen AI features

  • Advanced: Deploy a full-stack application

    • Combine front-end and back-end no-code tools.
      • Implement complex workflows and data integrations.
      • Ensure scalability and responsiveness.
  • Customer Experience / Platform Engineer @Appleseed.works

  • Automation Engineer / Automation Platform Engineer @Kono.team

  • Demonstrate knowledge of RPA tools

  • Implement Gen AI automation

    • Leverage AI services in automation
      • Integrate AI completion in an Automated Workflow
  • Demonstrate API integration

  • Advanced: Build a business automation solution

    • Combine RPA, AI, and API integrations.
      • Automate a complex business process end-to-end.
      • Document the workflow and tools used.
  • Information Systems / Business Analyst / Platform Engineer @Kono.team

    • Demonstrate basic knowledge of cloud systems

      • Identify and sign up for a software as a service which has a developer API (CRM, Project Management, etc.)
      • Salesforce, Hubspot, etc.
      • Notion, Jira, Todoist, Trello
      • Identify and sign up for a platform as a service on which you can deploy front end, back end code
      • Heroku, Vercel, AWS Lambda
      • Netlify, Vercel, Render
      • Identify and signup for a infrastructure as a service on which you can manage virtual machines
      • DigitalOcean, AWS, Azure
    • Demonstrate basic knowledge general rapid prototyping no code platform as a service

      • Using a rapid prototyping platform create a form to collect data from a potential job seeker (name, email, LinkedIn, GitHub, address, zip)
      • Airtable, Google Forms, etc.
      • Zoho App Creator, etc.
    • Demonstrate basic knowledge general automation platform platforms as a service

      • Using a general automation platform take data from a source system when data is entered and send it to a destination system in real-time
      • Zapier, Make
      • Microsoft Flow, Zoho Flow
    • Demonstrate basic knowledge of general integration platforms platforms as a service

      • Using a general automation platform take data from a source system, transform it, and then import it into a database
      • StitchData, XPlenty, Databox
    • Demonstrate basic knowledge of general business intelligence platforms as a service

      • Using a general business integration platform as a service retrieve data from an outside source such as an API or a database and visualize it in some way
      • Domo, Tableau, Redash, Metabase

Please submit:

  • Documentation of your work (code snippets, screenshots, write-ups) in a presentation or a document.
  • A brief explanation of your approach and any challenges faced.
  • Any additional research or resources you utilized.