Help us shape the future of .NET for Apache Spark

Question Title

* 1. Which of the following best describes your role?

Hobbyist

Academic Researcher

Data Engineer (Develops data processing pipelines and scripts to prepare and curate data from a variety of sources)

Data scientist (Build custom ML Models for a given data set and business problem)

Developer (Develops end user applications, some of which require access to curated data)

Business Analyst (Develops reports and runs queries on curated data)

Other (please specify)

Question Title

* 2. How would you describe your company?

Start-up

Small-sized company (< 100 employees)

Freelancer, consultant, self-employed

Large-sized company (> 1000 employees)

None of the above (e.g. I am a student or hobbyist)

Medium-sized company (100 - 1000 employees)

Other (please specify)

Question Title

* 3. What language do you use for your application development?

Node

Swift

SQL

.NET

JavaScript

PHP

Julia

C++

Java

Scala

Python

Other (please specify)

Question Title

* 4. What kind of apps are you building?

Mobile

Desktop

Cloud

None

Games

Internet of Things

Web

Other (please specify)

Question Title

* 5. How would you describe your current usage of Big Data and Apache Spark?

Recently started developing Big Data solution (<6 months ago)

Interested in learning about Big Data but have not actively developed any solutions

Not interested in Big Data

Actively developing and leveraging Big Data solutions

Other (please specify)

Question Title

* 6. What tools do you use for building your Big Data and Apache Spark jobs?

Data Ingestion Tools (Azure Data Factory, StreamSets, Talend, Oozie etc.)

Jupyter Notebooks or REPL environments

SQL Editor (e.g. RedGate, JetBrains DataGrip, Azure DataStudio)

Data Wrangling tools (e.g. Paxata, Trifacta)

Integrated Development Environments (e.g. IntelliJ, Visual Studio, XCode, Spyder etc.)

ML tools (e.g. Azure ML, RapidMiner, Data Robot, Dataiku, H20.ai)

Code Editors (e.g. Visual Studio Code, Sublime, Notepad, Vim etc.)

Data management tools (Azure Data Catalog, Waterline Data, Informatica, Apache Atlas etc.)

Other (please specify)

Question Title

* 7. Which frameworks, libraries and cloud services have you used for Big Data?

Presto

Azure HDInsight

MongoDB

DataBricks

Apache Hadoop

Google Dataproc, BigQuery etc.

Microsoft Prose SDK

Amazon EMR etc.

Apache Spark

Azure Stream Analytics

Cloudera / Hortonworks

AI Batch

Azure Time Series Insights

Azure Data Lake

Azure EventHub (Kafka)

None -- I have not used Big Data

Apache Kafka

Apache Hive

Other (please specify)

Question Title

* 8. How best would you explain the use of Big Data in your organization (e.g. Data Warehousing, Real Time/Streaming solutions, Log Processing etc.)

Question Title

* 9. Have you had a chance to play with .NET for Apache Spark? If so, how was your experience?

Yes

If Yes, please explain