[#247] [spark] Bump Spark Version to 2.4.7 to support GCP dataproc-release-1.5

[Dee-Pac]

Make sure you have checked all steps below.

GitHub Issue

Fixes #247

Checklist:

• This pull request updates the documentation
• This pull request changes library dependencies
• Title of the PR is of format (example) : [[Github] Add Pull Request Template #25][Github] Add Pull Request Template

What is the purpose of this pull request?

• Trims Spark Logging module that had multiple versions bundled.
• Deprecates prior Kafka versions
• Cleans-up the repo
• Mainly, bumps up the spark version
• Improves documentation

How was this change validated?

• Testing in progress

Commit Guidelines

• My commits all reference GH issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "How to write a good git commit message":
  1. Subject is separated from body by a blank line
  2. Subject is limited to 50 characters
  3. Subject does not end with a period
  4. Subject uses the imperative mood ("add", not "adding")
  5. Body wraps at 72 characters
  6. Body explains "what" and "why", not "how"

[sathishsri88]

👍