Jeremy blog post 1 (Paper motivation critique) #1
Conversation
| asking them open-ended questions about problems during execution and their | ||
| opinions of the severity of the problems they encountered. | ||
|
|
||
| The related work is partially presented in the introduction and partially |
There was a problem hiding this comment.
Can you clarify what the problem, gap, and hook are? You briefly talk about the gap (few studies about executability), but without an explicit problem and an explicit hook it's not clear why anyone should care about executability.
Is the problem that not enough tutorials include code examples? That tutorials don't include enough human annotations of the code examples? That users have trouble following tutorials? Something else altogether? It's unclear from your writeup.
Similarly for the hook: Who cares if this study is published? What are the implications?
| tutorials: at most existing work studied the executability of Jupyter notebooks | ||
| or code found on Stack Overflow. | ||
|
|
||
| The authors clearly use theory, citing properties of an ideal tutorial directly |
There was a problem hiding this comment.
This paragraph is unclear. First, why do "existing guidelines published by DigitalOcean" constitute "theory" in the sense we discussed in class? It sounds more like anecdotes to me.
Second, the last sentence (The theory is that if code is not executable, it is less useful) reads disconnected from the rest of the paragraph. How is executability related to explaining every step and imparting knowledge?
Finally, re "The theory is that if code is not executable, it is less useful," is this something the authors postulate in this paper or something well established? What is the evidence for it?
| be naively executed? If not, Why?" and "Can tutorials be executed with limited | ||
| human annotation?". | ||
|
|
||
| They conducted a mixed-methods study to answer these questions. First, they |
There was a problem hiding this comment.
Say something about why this design was appropriate / ideal given the RQs.
|
Thanks, good writeup overall. I left a few suggestions for things to clarify to further improve it. |
No description provided.