GUI terminal widget

Background

Way back in January 2012, jwe posted the following message about changing the terminal widget in the GUI to handle input differently. This question was addressed again in May 2019.

Jwe included a simple example written with gtkmm to illustrate the idea of having the terminal widget in the GUI be in control of input and output and feed lines of text to the interpreter. To properly handle input that spans multiple lines, a push parser is used instead of the current pull parser. It worked as an example, but was not much help for Octave since we are using Qt. So now jwe has reworked it using Qt and you can find the sources here:

https://hg.octave.org/jwe-qt-gui-with-push-parser

See the NOTES file for build instructions. That file also contains the following list of open questions that will need to be resolved if we are going to attempt a switch.

Open questions

Threads

1. With this arrangement, would the interpreter have to run in a separate thread? As the example shows, it's not absolutely necessary. It could offer some advantages, but only if it is possible for the GUI to do useful things while the interpreter is busy.
2. If the interpreter is not running in a separate thread but but the graphics engine is, then what happens to graphics callbacks when the parser is in the middle of parsing an expression? Or is this not an issue because separate parsers can be used even if there is only one evaluator? Could it ultimately be possible to have the evaluator running in multiple threads?
3. If the interpreter does run in a separate thread, we still must wait for it to calculate and return a result so we can synchronize input and output. Otherwise, we may print the next prompt before the output from the previous expression is evaluated and printed. You'll see this behavior if you build the example program with CALC_USE_INTERPRETER_THREAD defined.

Multiple-line handling

1. The example parser currently also performs evaluations and computes results immediately so it doesn't properly handle expression lists that are split across multiple lines. Octave wouldn't have this problem because we already build a parse tree then execute it once it is complete.
2. The example program doesn't attempt handle multi-line prompts or prompts with invisible characters (color specifications, for example). Fixing that will make the redisplay function significantly more complex. See, for example, how complicated the default rl_redisplay function is in the readline library. Unless we actually write a terminal emulator (like the current terminal widgets) then it is not possible to use readline's rl_redisplay function directly.

Cursor position

1. Do we need text position markers to keep track of the prompt position (beginning of current line) when inserting or clearing text? This doesn't seem necessary in the current example, but it doesn't have functions that can clear the screen or otherwise redraw prior output that would cause the position of the cursor in the window to change.

Pager

1. We'll need to implement a pager ourselves, since "less" won't work in this simplified terminal widget.

History

1. If readline runs in the terminal widget, who owns the command-line history? Either way, if the GUI is in control of keyboard input, it will need access to the history list and Octave will also need access for the history functions.

External programs / Portability

1. The system function may need to be modified so that external programs that expect to be running in a terminal will continue to work properly. On Unixy systems, this job can be done with ptys. I guess Windows systems can use a hidden console? But if these things are required, are we more or less back to were we were before since we used a pty and hidden console to implement the terminal widgets? I believe the Emacs start-process function must do similar things, so we might be able to reuse that code.

International Characters Support

1. Does GNU Readline support Unicode input? What are the limiting factors to support Unicode? -- If correctly configured, reasonably recent versions of GNU readline support UTF-8 if LC_CTYPE is set to a UTF-8 locale. Versions 6.1 and newer versions should be working if the user didn't override "meta-flag", "convert-meta", or "output-meta" (maybe also others). Having said so: Setting LC_CTYPE to a UTF-8 locale is invalid on Windows.
2. Can the open bugs (#56173 (probably unrelated), #47571 (probably resolved), #43099 (probably resolved)) be resolved with the new solution?

Alternatives

1. qtconsole
   • (+) Fancy interactive features including plots
   • (+) Contains history and a pager
   • (-) Written in Python
2. qtermwidget
   • (+) Reusable component (less Octave code) as shared and development library Debian, openSUSE.
   • (+) Contains history (and a pager?)
   • (+) Written in C++
   • (-) AFAIK, the current implementation was forked from this implementation some years ago. It deviated quite substantially which makes merging difficult and which might suggest that the original implementation doesn't fit our needs (confirmation needed).
   • (-) Not cross-platform (no Windows support).