Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for GPT-4-Vision and longer contexts #447

Merged
merged 15 commits into from
Nov 11, 2023
Merged

Add support for GPT-4-Vision and longer contexts #447

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
449bff4
WIP support for gpt-4-vision
rhennigan Nov 7, 2023
f199825
Bugfix: display failure in place of inline tool call when tool call c…
rhennigan Nov 7, 2023
78c865e
No more "wolfram_language_evaliator"
rhennigan Nov 7, 2023
00692e9
Bugfix: new gpt-4 frequently uses `\(`, `\)`, `\[`, and `\]` to denot…
rhennigan Nov 8, 2023
78a4145
Big updates to support gpt-4-vision
rhennigan Nov 11, 2023
a495ffa
Misc improvments to `CurrentChatSettings`
rhennigan Nov 11, 2023
40b214c
Quiet messages due to ChatObject not handling multimodal content
rhennigan Nov 11, 2023
50f6bc7
Handle new behavior quirks introduced by gpt-4-1106
rhennigan Nov 11, 2023
dbae5cf
Preserve italic and bold when serializing cells
rhennigan Nov 11, 2023
e10ad56
Wrap "InlineCode" cells in backticks
rhennigan Nov 11, 2023
c9dc816
Moved definition for fasterCellToString0 to have lower priority
rhennigan Nov 11, 2023
ba3dfbc
Serialize text hyperlinks as markdown
rhennigan Nov 11, 2023
4e76201
Suppress a message that's occasionally generated by W|A boxes
rhennigan Nov 11, 2023
df5876c
Set starting budget for cell string lengths and decrease as message c…
rhennigan Nov 11, 2023
c99111a
Remove "NotImplemented" message (this is supposed to be unreachable now)
rhennigan Nov 11, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 2 additions & 4 deletions Source/Chatbook/Actions.wl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -113,7 +113,6 @@ ChatbookAction[ "TabRight" , args___ ] := catchMine @ TabRight @ arg
ChatbookAction[ "ToggleFormatting" , args___ ] := catchMine @ ToggleFormatting @ args;
ChatbookAction[ "ToolManage" , args___ ] := catchMine @ ToolManage @ args;
ChatbookAction[ "WidgetSend" , args___ ] := catchMine @ WidgetSend @ args;
ChatbookAction[ name_String , args___ ] := catchMine @ throwFailure[ "NotImplemented", name, args ];
ChatbookAction[ args___ ] := catchMine @ throwInternalFailure @ ChatbookAction @ args;

(* ::**************************************************************************************************************:: *)
Expand Down Expand Up @@ -634,8 +633,9 @@ CopyChatObject // endDefinition;
(*constructChatObject*)
constructChatObject // beginDefinition;

(* cSpell: ignore bdprompt *)
constructChatObject[ messages_List ] :=
With[ { chat = chatObject @ standardizeMessageKeys @ messages },
With[ { chat = Quiet[ ChatObject @ standardizeMessageKeys @ messages, ChatObject::bdprompt ] },
chat /; MatchQ[ chat, _chatObject ]
];

Expand All @@ -644,8 +644,6 @@ constructChatObject[ messages_List ] :=

constructChatObject // endDefinition;

chatObject := chatObject = Symbol[ "System`ChatObject" ];

(* ::**************************************************************************************************************:: *)
(* ::Subsubsection::Closed:: *)
(*standardizeMessageKeys*)
Expand Down
Loading
Loading