Shubham Kumar
PA@Cognizant | 4x Azure| 1x AWS| 1x Informatica| 1x GCP| 1x Databricks| 1x Oracle Cloud Certified
- Report this post
#Part1🚀Let's Discover Databricks : Sharing some key Databricks terms to give an overview of the different points that will use when running Databricks environmeent:🔆Workspace: This is the central place that will allow you to organize all the work that’s being done. You can think of it as a ‘folder’ structure where you can save Notebooks and Libraries that you want to operate on and manipulate data with, and then share them securely with other users. Workspace is not meant for storing data; data should be stored in the data storage.🔆Notebooks: This is a set of any number of cells that allow you to execute commands with a programming language, such as Scala, Python, R or SQL; you can specify the language when you open a cell at the top of the Notebook. Here you can also create a dashboard that allows the output of the code to be shared rather than the code itself, and they can be scheduled as jobs for running pipelines, updating models or dashboards.🔆Libraries: Librariesare the plugins of Databricks, providing additional functionality. Whether you’re using a data manipulation package in Python or a machine learning library in Scala, libraries can be installed on clusters to enhance your code’s capabilities.🔆Tables: This is where the structured data is stored that you and your team will use for analysis. They can live in cloud storage or in the cluster that’s being used or store them in memory for faster processing of the data.🔆Clusters: Clustersprovide the computational horsepower needed to analyze data. Customizable based on your needs, you can configure clusters by specifying the type of machines to use, autoscaling options, and more. Clusters can be controlled via access policies using Active Directory integration.🔆Jobs: In Databricks,Jobsare scheduled or triggered tasks that are run on Databricks clusters. These can be notebook workflows or JARs.#databricks#azuredatabricks#LinkdInLearning#dataanalyst#dataengineer
1
To view or add a comment, sign in
More Relevant Posts
-
Shubham Kumar
PA@Cognizant | 4x Azure| 1x AWS| 1x Informatica| 1x GCP| 1x Databricks| 1x Oracle Cloud Certified
- Report this post
I’m happy to share that I’ve obtained a new certification: Dataiku Certified: Core Designer Certification!CDC 2024 ✅View my verified achievement from Dataiku.Thank you Cognizant for the opportunity.#dataiku #cognizant #certification #cdc #dataikucoredesigner #cognizant #dataikucertified #coredesignercertified
17
1 Comment
Like CommentTo view or add a comment, sign in
-
Shubham Kumar
PA@Cognizant | 4x Azure| 1x AWS| 1x Informatica| 1x GCP| 1x Databricks| 1x Oracle Cloud Certified
- Report this post
I’m happy to share that I’ve obtained a new certification: Oracle Certified: Oracle Cloud Infrastructure Certified Foundations Associate!OCI 2023 ✅View my verified achievement from Oracle.Thank you Cognizant for the opportunity.#oracle #certification #oci #oraclecloudinfrastructure #oraclefundamentals #cognizant #oraclecertified #oracle
See AlsoResearchers from Columbia University and Databricks Conducted a Comparative Study of LoRA and Full Finetuning in Large Language ModelsDatabricks-Machine-Learning-Associate Exam Practice Test Instant AccessDefining the Azure Databricks connection parameters for Spark JobsUploading files to DBFS (Databricks File System)14
1 Comment
Like CommentTo view or add a comment, sign in
-
Shubham Kumar
PA@Cognizant | 4x Azure| 1x AWS| 1x Informatica| 1x GCP| 1x Databricks| 1x Oracle Cloud Certified
- Report this post
I’m happy to share that I’m starting a new position as Programmer Analyst at Cognizant!
This content isn’t available here
Access this content and more in the LinkedIn app
53
12 Comments
Like CommentTo view or add a comment, sign in
-
Shubham Kumar
PA@Cognizant | 4x Azure| 1x AWS| 1x Informatica| 1x GCP| 1x Databricks| 1x Oracle Cloud Certified
- Report this post
I’m happy to share that I’ve obtained a new certification: Microsoft Certified: Power Fundamentals from Microsoft!PL-900 ✅View my verified achievement from Microsoft.Thank you Cognizantfor the opportunity.#microsoft #certification #pl900 #powerplatform #microsoftfundamentals #cognizant #microsoftcertified
10
1 Comment
Like CommentTo view or add a comment, sign in
-
Shubham Kumar
PA@Cognizant | 4x Azure| 1x AWS| 1x Informatica| 1x GCP| 1x Databricks| 1x Oracle Cloud Certified
- Report this post
View my verified achievement from Databricks.#lakehouse #databricks
20
Like CommentTo view or add a comment, sign in
-
Shubham Kumar
PA@Cognizant | 4x Azure| 1x AWS| 1x Informatica| 1x GCP| 1x Databricks| 1x Oracle Cloud Certified
- Report this post
Hi Everyone,I completed the Informatica #MDMSaaScertification foundation level series.
16
1 Comment
Like CommentTo view or add a comment, sign in
-
Shubham Kumar
PA@Cognizant | 4x Azure| 1x AWS| 1x Informatica| 1x GCP| 1x Databricks| 1x Oracle Cloud Certified
- Report this post
I’m happy to share that I’ve obtained a new certification: GCP Certified: GCP Certified Associate Cloud Engineer!GCP- ACE✅View my verified achievement from GCP.Thank youCognizantfor the opportunity.https://lnkd.in/dqpZjsZ3#gcp#certification#ace#gcpcloud #gcpace #cognizant#gcpcertified
34
2 Comments
Like CommentTo view or add a comment, sign in
-
Shubham Kumar
PA@Cognizant | 4x Azure| 1x AWS| 1x Informatica| 1x GCP| 1x Databricks| 1x Oracle Cloud Certified
- Report this post
I’m happy to share that I’ve obtained a new certification: AWS Certified: AWS Certified Cloud Practitioner!CLF-C01✅View my verified achievement from AWS.Thank youCognizantfor the opportunity.#aws#certification#clf_c01#awscloud #awscloudpractitioner #cognizant#awscertified
23
3 Comments
Like CommentTo view or add a comment, sign in
-
Shubham Kumar
PA@Cognizant | 4x Azure| 1x AWS| 1x Informatica| 1x GCP| 1x Databricks| 1x Oracle Cloud Certified
- Report this post
View my verified achievement from Amazon Web Services (AWS).
26
Like CommentTo view or add a comment, sign in
5,960 followers
- 31 Posts
View Profile
Follow