diff_months: 17

Implement your own Girvan-Newman algorithm using the Spark Framework

Flat 50% Off Order New Solution
Added on: 2023-03-18 08:35:43
Order Code:
Question Task Id: 0

1. Overview

To explore the spark GraphFrames library as well as implement your own Girvan-Newman algorithm using the Spark Framework to detect communities in graphs. You will use the
Network Data Repository for this. The goal is to practice how to use the Girvan-Newman algorithm to detect communities in an efficient way within a distributed environment.

2. Requirements
2.1 Programming Requirements
a. You must use Python to implement al tasks.

b. You can use the Spark DataFrame and GraphFrames library for task1, but for task2 you can ONLY use Spark ROD and standard Python libraries.

2.2 Programming Environment Python 3.7+ and Spark 3.3.2
2.3 Write your own code.

2.4 What you need to turn in.

Your submission must be a zip file with the name convention:

You should pack the following required (and optional) files in the zip file (see Figure 1):

IRS her

a.1 [REQUIRED] two Python notebooks if used Google Colab, named: (all lowercase)


2.2 [REQUIRED two Python scripts if not used Google Colab, named: (all lowercase)


[REQUIRED] thy n Lower

i 1 : (al
firstname_lastname_hw1. jar

. [OPTIONAL] You can include other scripts to support your programs, and name it with the

firstname_lastname_filename. py


  • Uploaded By : Katthy Wills
  • Posted on : March 18th, 2023
  • Downloads : 0
  • Views : 425

Order New Solution

Can't find what you're looking for?

Whatsapp Tap to ChatGet instant assistance

Choose a Plan


80 USD
  • All in Gold, plus:
  • 30-minute live one-to-one session with an expert
    • Understanding Marking Rubric
    • Understanding task requirements
    • Structuring & Formatting
    • Referencing & Citing


30 50 USD
  • Get the Full Used Solution
    (Solution is already submitted and 100% plagiarised.
    Can only be used for reference purposes)
Save 33%


20 USD
  • Journals
  • Peer-Reviewed Articles
  • Books
  • Various other Data Sources – ProQuest, Informit, Scopus, Academic Search Complete, EBSCO, Exerpta Medica Database, and more