Overview
Examples
Screenshots
Comparisons
Applications
Download
Documentation
Tutorials
Bazaar
Status & Roadmap
FAQ
Authors & License
Forums
Funding Ultimate++
Search on this site
Search in forums












SourceForge.net Logo
Home » Developing U++ » Bazaar » A terminal emulator widget for U++
A terminal emulator widget for U++ [message #51415] Sat, 23 March 2019 22:31 Go to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
Hello,

tl;dr: I am going to publish a terminal emulator widget for U++, in the following month (April).

From the user POV, it is a very simple Ctrl that can be embedded in any U++ applications via traditional U++ way: (E.g. Add(terminal.SizePos())
And it has a very "thin" public api.
Also its page and parser components are completely decoupled, and documented, and can be used seperately in any project (Read: You can write your own terminal emulator that suits your need with ease).

Before I publish it, I'd like to know what features you would like to see in it.

Currently it is more capable than Win10's new ANSI console.


At the moment it supports:
- VT52/ANSI/1xxx/2xx and -partially- 4xx/5xx emulation and Xterm extension.
- Both 7-Bit and 8-Bit modes.
- UTF8
- OCS and DCS
- ANSI colors
- Alternate screen buffer. 
- Resize


Planned:

- Copy-paste support
- Scrollback buffer
- Mouse support
- And various optimizations.



I will also publish two reference examples with it: a simple terminal emulator constructed with Terminal widget, and a remote terminal to demonstrate SSH integration.

A screenshot is much more meaningful than words.
(On a humble test setup (Linux 5.0/Gnone/relatively old test AMD machine. Top row: Nano editor, AnsiArt, Vttest. Bottom row: Emacs, Top, RadeonTop).

index.php?t=getfile&id=5789&private=0

Best regards.
Oblivion


[Updated on: Sat, 23 March 2019 22:35]

Report message to a moderator

Re: A terminal emulator widget for U++ [message #51422 is a reply to message #51415] Sun, 24 March 2019 16:15 Go to previous messageGo to next message
koldo is currently offline  koldo
Messages: 2990
Registered: August 2008
Veteran
Maybe a sample of it could be a kind of new Putty.
Putty is so basic that with any feature you would add, yours would be better. And in U++ Smile


Best regards
Iñaki

[Updated on: Sun, 24 March 2019 16:16]

Report message to a moderator

Re: A terminal emulator widget for U++ [message #51444 is a reply to message #51422] Tue, 26 March 2019 10:02 Go to previous messageGo to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
Hello Koldo,

Quote:
Maybe a sample of it could be a kind of new Putty.
Putty is so basic that with any feature you would add, yours would be better. And in U++


Sure. Currently a barebone SSH terminal example (with the upconing Terminal ctrl), and TERM variable set to "xterm") in U++ is 52 lines of code. (Single file, password authentication).


What I have also in my mind is VirtualGui integration. Smile

Think about accessing to your server or machine via a terminal running on web browser with SSL, on-demand.

This would be a very cool and (somewhat unique?) feature. And it's high on my TODO list. Smile


Best regars,
Oblivion


[Updated on: Tue, 26 March 2019 10:06]

Report message to a moderator

Re: A terminal emulator widget for U++ [message #51448 is a reply to message #51422] Tue, 26 March 2019 13:11 Go to previous messageGo to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
And here it is. It took five minutes. We now have terminal access over web browsers, using TURTLE Smile
It works as expected.

This is the problem with U++: It is so good yet so underrated. :/


Screenshot:

index.php?t=getfile&id=5793&private=0

Best regards,
Oblivion


Re: A terminal emulator widget for U++ [message #51449 is a reply to message #51448] Tue, 26 March 2019 13:21 Go to previous messageGo to next message
koldo is currently offline  koldo
Messages: 2990
Registered: August 2008
Veteran
Laughing

Best regards
Iñaki
Re: A terminal emulator widget for U++ [message #51462 is a reply to message #51448] Wed, 27 March 2019 23:14 Go to previous messageGo to next message
Novo is currently offline  Novo
Messages: 889
Registered: December 2006
Experienced Contributor
Oblivion wrote on Tue, 26 March 2019 08:11
And here it is. It took five minutes. We now have terminal access over web browsers, using TURTLE Smile
It works as expected.

Are you able to run a Release version of your terminal emulator using TURTLE?
I'm asking this because I'm unable to run a Release version of WebWord (a demo app).


Regards,
Novo
Re: A terminal emulator widget for U++ [message #51463 is a reply to message #51462] Thu, 28 March 2019 08:01 Go to previous messageGo to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
Hello Novo,

Quote:

Are you able to run a Release version of your terminal emulator using TURTLE?
I'm asking this because I'm unable to run a Release version of WebWord (a demo app).


Yep, it works on Linux on localhost:8088 with latest versions of U++, gcc. I have yet to test it (Turtle build) on CLANG or Windows.

Setting the Ctrl::host to localhost was sufficient.

The only problem I encountered was the loss of caret due to losing focus.

Best regards,
Oblivion


[Updated on: Thu, 28 March 2019 08:20]

Report message to a moderator

Re: A terminal emulator widget for U++ [message #51465 is a reply to message #51463] Thu, 28 March 2019 16:57 Go to previous messageGo to next message
Novo is currently offline  Novo
Messages: 889
Registered: December 2006
Experienced Contributor
Oblivion wrote on Thu, 28 March 2019 03:01

Setting the Ctrl::host to localhost was sufficient.

Thanks a lot!

I didn't realize that Ctrl::host is used to connect back from JavaScript to a server.
I still have several problems like I cannot create more than one connection, although Release configuration is forking. And WebWord is using 100% of CPU because it is spinning in a connection loop which doesn't have any timeouts.

Are you experiencing the same problems or is it something related to my web-server setup?


Regards,
Novo
Re: A terminal emulator widget for U++ [message #51468 is a reply to message #51465] Thu, 28 March 2019 19:21 Go to previous messageGo to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
Quote:

Are you experiencing the same problems or is it something related to my web-server setup?


Yes, after you've pointed out, I've checked the behaviour and it is indeed eating a lot of CPU cylcles (On Linux 5.0, GCC, release mode, AMD ryzen) I get 16% cpu usage in idle state).

Good news is I found a possible candidate and a workaround (or fix maybe?) but Mirek should see it first.

İn Turtle/Server.cpp, method StartSession(), the for loop in between ln 75-123 (where the server is waiting for connections) seems to be the problem:

A simple workaround or a possible fix is to call Sleep(10) in ln: 75.

E.g.
for(;;) {
	if(quit)
		return false;
	Sleep(10);	// Let's eat less CPU cycle while waiting for connections.
//...



OTOH, there are also bad news:

1) It ssems impossible to open multiple clients at once (at leasy on Firefox (latest).
Symptom: When trying to open a second connection to turtle server, tab immediately closes (yet a second webword process runs in the background!).
2) I've noticed a potential security flaw: Closing the client using the client's "close window" button does not clear the browser tab (or canvas). It should. Or else sensitive data may be visible.


Best regards.
Oblivion


Re: A terminal emulator widget for U++ [message #51517 is a reply to message #51415] Mon, 08 April 2019 11:45 Go to previous messageGo to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
As the day that I'll publish the code on my github repo draws closer, final bits for the first version of TerminalCtrl are coming together well.

- Scrollback buffer is implemented.
- Chameleon (theme) support is implemented.
- VT52/1xx/2xx keyboard (with function keys) support is implemented.
- Conformance levels support is added (i.e. it is now possible to restrict the operation level to e.g. VT52, VT102, or VT220 etc.)


Here is a screenshot.
On the left is our SSH package/SshShell (running in console mode) running on TerminalCTrl, with scrollback buffer enabled.
In the middle is TerminalCtrl running with the widely used "Solarized theme"
On the right is the mighty emacs, with dropdown menus and function keys on default theme.

index.php?t=getfile&id=5798&private=0


Suggestions are welcome.

Best regards,
Oblivion


[Updated on: Mon, 08 April 2019 12:24]

Report message to a moderator

Re: A terminal emulator widget for U++ [message #51748 is a reply to message #51415] Mon, 13 May 2019 13:47 Go to previous messageGo to next message
Xemuth is currently offline  Xemuth
Messages: 108
Registered: August 2018
Location: France
Experienced Member
Hello Oblivion,

Very good job, it seems to be awesome.
I will try it on my Raspberry with TURTLE !

When do you think you'll publish it ? Embarassed

Thanks in advance,
Best Regard
Re: A terminal emulator widget for U++ [message #51752 is a reply to message #51748] Tue, 14 May 2019 09:57 Go to previous messageGo to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
Hello Xemuth,
Xemuth wrote on Mon, 13 May 2019 14:47
Hello Oblivion,

Very good job, it seems to be awesome.
I will try it on my Raspberry with TURTLE !

When do you think you'll publish it ? Embarassed

Thanks in advance,
Best Regard


Terminal packaga is already delayed (initially I'd planned to publish it in April).
Good news is that the first version of the package is basiaclly complete. So it will be published at the end of this month.

Currently I am making some profiling and optimizations (which led to 37% performance gain and 30% less memory consumption on average.
Also, now the parser is a complete vt parser, i.e. it can handle every single VT instruction (not every command is implemented though) correctly from VT52 to Vt520)
I am testing it with vttest, xterm's and ncurses's test tools. And fixing some "paper-cuts" that I have noticed. Smile


Best regards,
Oblivion


[Updated on: Tue, 14 May 2019 09:58]

Report message to a moderator

Re: A terminal emulator widget for U++ [message #51823 is a reply to message #51415] Sat, 08 June 2019 16:48 Go to previous messageGo to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
Hello,

A small but "big" update.

Terminal ctrl for U++ is on its way, and here is a short video preview:


https://vimeo.com/341085501


It is now mostly compatible with xterm.

-- Mouse tracking support added. Terminal can now handle mouse events if they are supported by the applications (See above video for example)
-- Bracketed paste mode added.
-- "G-sets" upport added. It now supports legacy applications that rely on font shifting (g0, g1, g2, g3, gl, gr).
-- DEC Technical charset is added.


Now I feel it is eligible for first release. (Probably next friday...)


P.s.: Terminal may seem sluggish in the video. (It is not.)
That's because I encoded it on my good old test machine, and I limited the framerate to 15.

Best regards,
Oblivion.


[Updated on: Sat, 08 June 2019 16:52]

Report message to a moderator

Re: A terminal emulator widget for U++ [message #52065 is a reply to message #51415] Sat, 13 July 2019 17:35 Go to previous messageGo to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
Hello,

It's been a while since I posted any news about the Terminal package. I had to focus on my other works fo a while.

The good news is last week I implemented the final missing pieces for the 0.1 release:

- 256 colors support added.
- ANSI colors support added.
- XTerm dynamic colors suppport added.
- VT 4xx rectangular area operations are added (copy, invert, move, fill, in both selective and normal modes)
- UDK (DEC's user-defined function keys support) added.
- Lazy resize option is added (to reduce flickers on network terminals uch as SSH-based ones)
- Size hint added.
- A .usc file is added to the Terminal package. (The most common options (font, ink, paper, cursor, sizehint etc.) can be set using TheIDE's layout editor. Also it shows a size hint (in calculated cell size) to simplfy positiong the widget in the layout ediyor.
- It is also tested on Windows, and it works well. :)  (currently as SSH terminal, in the near future as a frontend for Windows power shell too) 


Two notes on the upcoming initial release:

1) Terminal package currently does not contain any external code/libaray. It uses U++, and it's plugins. Smile
2) Although a virtual terminal requires a pty device, and Terminal pacjage contains one, they are completely decoupled.
Terminal ctrl can be used and compiled without PtyProcess. This gives it a huge flexibility
In this regard I will provide 4 basic examples with the package:
- TerminalExample | Uses ptyprocess (currently ptyprocess requires POSIX-compliant operationg systems (or possibly cygwin on Windows.)
- TerminalExampleWithLayout | The same as above.
--------------------------------
- SShTerminalExample | Does not use PtyProcess. IT uses Core/SSH package isntead
- SshTerminalExampleWithLayout | The same as above.


Here is the actual code of TerminalExample (36 LOCs total):

#include <Core/Core.h>
#include <Terminal/Terminal.h>

using namespace Upp;

const char *nixshell = "/bin/bash";

struct TerminalExample : TopWindow {
	Terminal	term;
	PtyProcess	pty;

	TerminalExample()
	{
		term.WhenBell	=   [=]()		{ BeepExclamation(); };
		term.WhenTitle	=   [=](String s)	{ Title(s); };
		term.WhenResize	=   [=]()		{ pty.SetSize(term.GetPageSize()); };
		term.WhenOutput	=   [=](String s)	{ PutGet(s); };
		SetRect(term.GetStdSize());	// 80 x 24 cells (scaled).
		Sizeable().Zoomable().CenterScreen().Add(term.SizePos());
		SetTimeCallback(-1, [=]()		{ PutGet(); });
		pty.Start(nixshell, Environment(), GetHomeDirectory());
	}
	
	void PutGet(String out = Null)
	{
		term.Write(pty.Get());
		pty.Write(out);
		if(!pty.IsRunning())
			Break();
	}
};

GUI_APP_MAIN
{
	TerminalExample().Run();
}




Below was a sort of "final boss" for the first release. It shows the mapscii, an OpenStreetMap implementation for terminal devices, running on the above code and on Gnome-terminal.
On the left is TerminalExample, running mapscii.
On the right is gnome terminal running mapscii
Both are running on 256 colors mode + mouse tracking support. Smile

index.php?t=getfile&id=5875&private=0


As a final note: Terminal package will be availabe within this weeek.


Best regards,
Oblivion

  • Attachment: Terminal.png
    (Size: 513.88KB, Downloaded 207 times)


[Updated on: Sat, 13 July 2019 17:39]

Report message to a moderator

Re: A terminal emulator widget for U++ [message #52075 is a reply to message #51415] Tue, 16 July 2019 09:34 Go to previous messageGo to next message
Xemuth is currently offline  Xemuth
Messages: 108
Registered: August 2018
Location: France
Experienced Member
Hello Oblivion,

Impressive work !
Re: A terminal emulator widget for U++ [message #52116 is a reply to message #51415] Sat, 20 July 2019 15:33 Go to previous messageGo to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
Hello,

It is time to unleash the beast Smile

The initial version of Terminal package is finally released.

I suggest you read the ReadMe.md on GitHub or the "Overview" doc (qtf) inluded in the package. It'll give you a better idea of what it is.

Github address of Terminal package: https://github.com/ismail-yilmaz/upp-components/tree/master/ CtrlLib/Terminal

Examples are included in the Examples section of my git repo.

Yes, but what is it?

Excerpt form the ReadMe.md on github:

Terminal package is a flexible, easy-to-use yet powerful cross-platform virtual terminal emulation library written in C/C++ for Ultimate++.

It is designed from the ground up with modularity and maintainability in mind. 
In this respect the package consists of several re-usable classes, only one being the Terminal widget.
	
## Requirements

- Ultimate++ (ver. >= 2019.1)
- POSIX, Windows (and probably MacOS, though not tested.)
- A decent enough C/C++ compiler that supports at least C++11. (GCC/CLANG/MinGW/Msc)
- Snacks & beer.

## Features

*Note that below list is only a summary of the currently supported features. Technical specifications and documentation will be available soon. 

- Supports whatever platform Ultimate++ supports. (Linux, Windows, MacOS).
- Supports VT52/VT1xx/VT2xx, partial VT4XX/5XX, and xterm emulation modes.
- Supports user configurable device conformance levels (1, 2, 3, 4, and 0 as VT52 emulation).
- Supports both 7-bits and 8-bits I/O.
- Supports Unicode/UTF8.
- Supports user configurable, legacy "g-set" (G0/G1/G2/G3), and related shifting functions (LS0/LS1/LS1R/LS2/LS2R/LS3/LS3R).
- Supports ANSI conformance levels.
- Supports various terminal state, device, and mode reports.
- Supports DEC VT52 graphics charset, VT1xx line-drawing charset, VT2xx multinational charset, and VT3xx technical charset.
- Supports VT52/VT1xx/VT2xx keyboard emulation with function keys.
- Supports UDK (DEC's user-defined function keys feature).
- Supports user configurable blinking text and blink interval.
- Supports ANSI colors (16 colors palette).
- Supports ISO colors (256 colors palette).
- Supports xterm dynamic colors (dynamic ink/paper/selection colors).
- Supports bright colors.
- Supports background color erase (BCE).
- Supports transparency (i.e. allows background images).
- Supports VT4xx rectangular area operations: copy, invert, fill. erase.
- Supports VT4xx rectangular area checksum calculation and reporting.
- Supports both DEC and ANSI style selective erases.
- Supports alternate screen buffer.
- Supports history/scrollback buffer.
- Has a user switchable scrollbar.
- Supports xterm style alternate scroll.
- Supports resize (and optional lazy resize to reduce flicker on network terminals such as SSH-based ones).
- Supports both immediate display refresh and delayed (buffered) display refresh.
- Supports xterm style mouse tracking: button, wheel, motion, focus in/out events.
- Supports user configurable cursor styles (block, beam, underscore, blinking/steady).
- Supports cursor locking.
- Supports clipboard operations (copy/paste/select all - including history buffer) and basic drag-and-drop ops.
- Supports bracketed paste mode.
- Has a predefined yet programmable context menu (left mouse button menu).
- Supports window titles.
- Supports bell notifications.
- Supports VT1xx LEDs.
- Supports size hint.
- Supports Ultimate++ style data serialization.
- Supports per-widget customization (i.e no global variables or properties are used).
- Includes a Terminal.usc file for TheIDE's layout editor.




Reviews, bug reports, patches, suggestions are welcome.

Best regards,
Oblivion


[Updated on: Sat, 20 July 2019 15:35]

Report message to a moderator

Re: A terminal emulator widget for U++ [message #52120 is a reply to message #51415] Sun, 21 July 2019 21:15 Go to previous messageGo to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
Hello,

A Turtle example is added to the package.
You can run the Terminal example in your favorite browser and see how it works. Wink

Terminal: https://github.com/ismail-yilmaz/upp-components/tree/master/ CtrlLib/Terminal
Example: https://github.com/ismail-yilmaz/upp-components/tree/master/ Examples/TerminalInWebBrowser

Also a name clash with Turtle is fixed.

Screenshot: Lynx running on Terminal in Firefox (a.k.a "Browserception")

index.php?t=getfile&id=5877&private=0


Best regards,
Oblivion


[Updated on: Sun, 21 July 2019 21:18]

Report message to a moderator

Re: A terminal emulator widget for U++ [message #52126 is a reply to message #51415] Mon, 22 July 2019 15:56 Go to previous messageGo to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
Hello,

More updates:

A terminal multiplexing example is added to the package.

This example demonstrates how a terminal multiplexing can be achieved simply by using a splitter widget. Splitter is a container ctrl that can be used to split any parent ctrl into resizeable horizontal and/or vertical panes. It also demonstrates the usage of NTL containers with Terminal widget:


Also a mouse capture issue is hopefully fixed.


Best regards,
Oblivon


Re: A terminal emulator widget for U++ [message #52137 is a reply to message #51415] Wed, 24 July 2019 13:24 Go to previous messageGo to next message
Oblivion is currently offline  Oblivion
Messages: 577
Registered: August 2007
Location: Turkey
Contributor
A short video demonstration of Terminal ctrl (simple multiplexing example running mapscii, htop, emacs, lynx nano..):

https://vimeo.com/349761874

Best regards,
Oblivion


[Updated on: Wed, 24 July 2019 13:25]

Report message to a moderator

Re: A terminal emulator widget for U++ [message #52139 is a reply to message #52137] Fri, 26 July 2019 08:18 Go to previous messageGo to previous message
koldo is currently offline  koldo
Messages: 2990
Registered: August 2008
Veteran
Terminal based world map viewer is cool Smile

Best regards
Iñaki
Previous Topic: Controls4U. removed operator= in EditFile/Folder
Next Topic: MessageCtrl: A passive notifications ctrl and manager.
Goto Forum:
  


Current Time: Thu Sep 19 06:33:30 CEST 2019

Total time taken to generate the page: 0.01560 seconds