Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate AWSAuth.jl into AWSCore.jl #88

Merged
merged 1 commit into from
Oct 28, 2019
Merged

Migrate AWSAuth.jl into AWSCore.jl #88

merged 1 commit into from
Oct 28, 2019

Conversation

mattBrzezinski
Copy link
Member

@mattBrzezinski mattBrzezinski commented Sep 19, 2019

Overview

This merge request is part of a larger overall refactor. Recently this merge request went through in HTTP.jl, it introduced the ability to add custom layers into the request stack. With that merge request being introduced we can now move the AWS4AuthLayer away from the HTTP.jl project.

We need to find a new home for AWSAuthLayer, at first glance it makes most sense to move this into the AWSAuth.jl package. However, looking at the state of the package, and open issues we can see why this might not be the best plan.

AWSAuth.jl has an open issue to move AWSCredentials from AWSCore.jl into it. However, if we did this we would introduce a circular dependency between AWSAuth.jl and AWSCore.jl. To get around this circular dependency we would need to move Services.jl into its own package. I do not think this is the best decision as we are creating more packages and not solving the core issue with the state of these packages.

AWSAuth.jl is a tiny package, which is just a duplicate of the AWS4AuthLayer in HTTP.jl. I propose that we move this entire functionality into AWSCore.jl, and archive AWSAuth.jl. The addition of this is not a heavy lift into AWSCore.jl and helps centralize these AWS packages.

I think this is a good step forward and will help clean up the current state of the JuliaCloud packages. Afterwards we can start looking ahead and re-designing the architecture behind these packages.

Next Steps

If this merge request is approved, we can clean up HTTP.jl and remove the AWS4AuthLayer code from that package as it already exists in this one. We can then begin looking into refactoring this package and making it more modular.

AWSAuth.jl can be archived as it no longer has a purpose.

Links

Issues deemed OOO that are logged:

@mattBrzezinski mattBrzezinski changed the title WIP: Moving AWSAuth into AWSCore Migrate AWSAuth.jl into AWSCore.jl Sep 23, 2019
@mattBrzezinski
Copy link
Member Author

bors try

bors bot added a commit that referenced this pull request Sep 23, 2019
@bors
Copy link
Contributor

bors bot commented Sep 23, 2019

try

Build succeeded

Copy link
Member

@omus omus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You may want to have separate PRs which just deal with moving code and whitespace changes. As this PR is it is hard to review and it's easy to miss things

README.md Outdated Show resolved Hide resolved
src/AWSAPI.jl Outdated Show resolved Hide resolved
src/AWSAPI.jl Outdated Show resolved Hide resolved
src/AWSAPI.jl Outdated Show resolved Hide resolved
src/AWSCore.jl Outdated Show resolved Hide resolved
src/AWSCore.jl Outdated Show resolved Hide resolved
src/AWSCredentials.jl Outdated Show resolved Hide resolved
src/AWSCredentials.jl Outdated Show resolved Hide resolved
src/AWSCredentials.jl Outdated Show resolved Hide resolved
@mattBrzezinski
Copy link
Member Author

You may want to have separate PRs which just deal with moving code and whitespace changes. As this PR is it is hard to review and it's easy to miss things

Yeah I can definitely see that, personally I've stared using the Viewed feature on GitHub to mark down files which I've reviewed already.

I can spend some time and split this up, or make a follow up CR based off of this one for non-functional changes. Marking this as WIP until I've completed those changes.

@mattBrzezinski mattBrzezinski changed the title Migrate AWSAuth.jl into AWSCore.jl WIP: Migrate AWSAuth.jl into AWSCore.jl Sep 23, 2019
@mattBrzezinski
Copy link
Member Author

bors try

bors bot added a commit that referenced this pull request Sep 23, 2019
@mattBrzezinski mattBrzezinski changed the title WIP: Migrate AWSAuth.jl into AWSCore.jl Migrate AWSAuth.jl into AWSCore.jl Sep 23, 2019
@bors
Copy link
Contributor

bors bot commented Sep 23, 2019

try

Build succeeded

test/credentials.jl Outdated Show resolved Hide resolved
test/xml.jl Outdated Show resolved Hide resolved
src/AWSCredentials.jl Outdated Show resolved Hide resolved
src/AWSCredentials.jl Outdated Show resolved Hide resolved
src/AWSCredentials.jl Outdated Show resolved Hide resolved
src/AWSCredentials.jl Outdated Show resolved Hide resolved
src/signaturev4.jl Outdated Show resolved Hide resolved
src/signaturev4.jl Outdated Show resolved Hide resolved
src/signaturev4.jl Outdated Show resolved Hide resolved
src/signaturev4.jl Outdated Show resolved Hide resolved
test/runtests.jl Outdated Show resolved Hide resolved
bors bot added a commit that referenced this pull request Oct 16, 2019
bors bot added a commit that referenced this pull request Oct 17, 2019
bors bot added a commit that referenced this pull request Oct 17, 2019
bors bot added a commit that referenced this pull request Oct 17, 2019
bors bot added a commit that referenced this pull request Oct 17, 2019
@mattBrzezinski mattBrzezinski changed the title Migrate AWSAuth.jl into AWSCore.jl WIP: Migrate AWSAuth.jl into AWSCore.jl Oct 21, 2019
bors bot added a commit that referenced this pull request Oct 21, 2019
bors bot added a commit that referenced this pull request Oct 21, 2019
@JuliaCloud JuliaCloud deleted a comment from bors bot Oct 21, 2019
@JuliaCloud JuliaCloud deleted a comment from bors bot Oct 21, 2019
@JuliaCloud JuliaCloud deleted a comment from bors bot Oct 21, 2019
@JuliaCloud JuliaCloud deleted a comment from bors bot Oct 21, 2019
@JuliaCloud JuliaCloud deleted a comment from bors bot Oct 21, 2019
bors bot added a commit that referenced this pull request Oct 21, 2019
@JuliaCloud JuliaCloud deleted a comment from bors bot Oct 21, 2019
bors bot added a commit that referenced this pull request Oct 24, 2019
@bors

This comment has been minimized.

@mattBrzezinski

This comment has been minimized.

bors bot added a commit that referenced this pull request Oct 24, 2019
@bors

This comment has been minimized.

@mattBrzezinski

This comment has been minimized.

bors bot added a commit that referenced this pull request Oct 24, 2019
@bors

This comment has been minimized.

@mattBrzezinski

This comment has been minimized.

bors bot added a commit that referenced this pull request Oct 24, 2019
@bors

This comment has been minimized.

@mattBrzezinski
Copy link
Member Author

Build passes, the ECS job just needed a good kicking to pass.

https://travis-ci.org/JuliaCloud/AWSCore.jl/builds/602521465

I'll kick it off again to get the proper notification.

@mattBrzezinski
Copy link
Member Author

bors try

bors bot added a commit that referenced this pull request Oct 24, 2019
@bors
Copy link
Contributor

bors bot commented Oct 24, 2019

try

Build succeeded

@iamed2
Copy link
Member

iamed2 commented Oct 24, 2019

bors r+

bors bot added a commit that referenced this pull request Oct 24, 2019
88: Migrate AWSAuth.jl into AWSCore.jl r=iamed2 a=mattBrzezinski

Overview
---
This merge request is part of a larger overall refactor. Recently this merge request went through in [HTTP.jl](JuliaWeb/HTTP.jl#443), it introduced the ability to add custom layers into the request stack. With that merge request being introduced we can now move the `AWS4AuthLayer` away from the `HTTP.jl` project.

We need to find a new home for `AWSAuthLayer`, at first glance it makes most sense to move this into the `AWSAuth.jl` package. However, looking at the state of the package, and open issues we can see why this might not be the best plan.

`AWSAuth.jl` has an open [issue](JuliaCloud/AWSAuth.jl#11) to move `AWSCredentials` from `AWSCore.jl` into it. However, if we did this we would introduce a circular dependency between `AWSAuth.jl` and `AWSCore.jl`.  To get around this circular dependency we would need to move [Services.jl](https://github.com/JuliaCloud/AWSCore.jl/blob/master/src/Services.jl) into its own package. I do not think this is the best decision as we are creating more packages and not solving the core issue with the state of these packages.

`AWSAuth.jl` is a tiny package, which is just a duplicate of the `AWS4AuthLayer` in `HTTP.jl`. I propose that we move this entire functionality into `AWSCore.jl`, and archive `AWSAuth.jl`. The addition of this is not a heavy lift into `AWSCore.jl` and helps centralize these AWS packages.

I think this is a good step forward and will help clean up the current state of the JuliaCloud packages. Afterwards we can start looking ahead and re-designing the architecture behind these packages.

Next Steps
---
If this merge request is approved, we can clean up `HTTP.jl` and remove the `AWS4AuthLayer` code from that package as it already exists in this one. We can then begin looking into refactoring this package and making it more modular.

[AWSAuth.jl](https://github.com/JuliaCloud/AWSAuth.jl) can be archived as it no longer has a purpose.

Links
---
- [AWSAuth.jl - Issue - Current state of the package](JuliaCloud/AWSAuth.jl#11)
- [HTTP.jl - CR - Add Custom Layers to request stack](JuliaWeb/HTTP.jl#443)
- [HTTP.jl - Issue - Move AWS4AuthLayer](JuliaWeb/HTTP.jl#355)

Issues deemed OOO that are logged:
---
- #90
- #91
- #92

Co-authored-by: Matt Brzezinski <[email protected]>
@bors
Copy link
Contributor

bors bot commented Oct 24, 2019

Canceled

@mattBrzezinski
Copy link
Member Author

bors try

bors bot added a commit that referenced this pull request Oct 24, 2019
@bors
Copy link
Contributor

bors bot commented Oct 24, 2019

try

Build succeeded

@mattBrzezinski
Copy link
Member Author

bors try

bors bot added a commit that referenced this pull request Oct 24, 2019
@bors
Copy link
Contributor

bors bot commented Oct 24, 2019

try

Build succeeded

Moved AWS4AuthLayer into this package from AWSAuth.jl. Originally wanted to
move AWSCredentials into AWSAuth.jl however this would create a circular
dependency. Instead we're moving AWS4AuthLayer into AWSCore.jl. This now
allows us to clean up HTTP.jl and remove AWS functionality from it.
@mattBrzezinski
Copy link
Member Author

bors r+

bors bot added a commit that referenced this pull request Oct 28, 2019
88: Migrate AWSAuth.jl into AWSCore.jl r=mattBrzezinski a=mattBrzezinski

Overview
---
This merge request is part of a larger overall refactor. Recently this merge request went through in [HTTP.jl](JuliaWeb/HTTP.jl#443), it introduced the ability to add custom layers into the request stack. With that merge request being introduced we can now move the `AWS4AuthLayer` away from the `HTTP.jl` project.

We need to find a new home for `AWSAuthLayer`, at first glance it makes most sense to move this into the `AWSAuth.jl` package. However, looking at the state of the package, and open issues we can see why this might not be the best plan.

`AWSAuth.jl` has an open [issue](JuliaCloud/AWSAuth.jl#11) to move `AWSCredentials` from `AWSCore.jl` into it. However, if we did this we would introduce a circular dependency between `AWSAuth.jl` and `AWSCore.jl`.  To get around this circular dependency we would need to move [Services.jl](https://github.com/JuliaCloud/AWSCore.jl/blob/master/src/Services.jl) into its own package. I do not think this is the best decision as we are creating more packages and not solving the core issue with the state of these packages.

`AWSAuth.jl` is a tiny package, which is just a duplicate of the `AWS4AuthLayer` in `HTTP.jl`. I propose that we move this entire functionality into `AWSCore.jl`, and archive `AWSAuth.jl`. The addition of this is not a heavy lift into `AWSCore.jl` and helps centralize these AWS packages.

I think this is a good step forward and will help clean up the current state of the JuliaCloud packages. Afterwards we can start looking ahead and re-designing the architecture behind these packages.

Next Steps
---
If this merge request is approved, we can clean up `HTTP.jl` and remove the `AWS4AuthLayer` code from that package as it already exists in this one. We can then begin looking into refactoring this package and making it more modular.

[AWSAuth.jl](https://github.com/JuliaCloud/AWSAuth.jl) can be archived as it no longer has a purpose.

Links
---
- [AWSAuth.jl - Issue - Current state of the package](JuliaCloud/AWSAuth.jl#11)
- [HTTP.jl - CR - Add Custom Layers to request stack](JuliaWeb/HTTP.jl#443)
- [HTTP.jl - Issue - Move AWS4AuthLayer](JuliaWeb/HTTP.jl#355)

Issues deemed OOO that are logged:
---
- #90
- #91
- #92

Co-authored-by: Matt Brzezinski <[email protected]>
@bors
Copy link
Contributor

bors bot commented Oct 28, 2019

Build succeeded

@bors bors bot merged commit 19e20b6 into JuliaCloud:master Oct 28, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants