Show Posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.


Topics - Ron D.

Pages: [1] 2 3
1
Announcements / Sliver 1.6 Released
« on: December 01, 2017, 10:42:42 PM »
Hi All,

It seems I did not announce the release of Sliver v1.5.5 back in September. Now Sliver v1.6 has just been released and is available at http://www.sliversoftware.com/download.htm.

There are a number of new features in v1.6, and you can see the new feature list for both the v1.5.5 and the new v1.6 releases in the Recent Version Change Log at http://www.sliversoftware.com/versionchangelog.htm or on page 3 of the User's Manual.

The standalone DataTools application was not updated with this new release, so it remains at the v1.2.8 release that coincided with the Sliver 1.5.5 release.

Thanks, everyone, for your support. Please let me know if you have any questions or suggestions regarding this new release or Sliver in general.

Ron

2
Announcements / Sliver 1.5 and DataTools 1.2.7 Released
« on: March 24, 2017, 11:39:12 PM »
Hi All,

Sliver v1.5 has just been released and is available at http://www.sliversoftware.com/download.htm. This significant release incorporates a number of new features.

Additional features rolled into this release include support for 2D scatterplots with point sizes based on another variable (also known as bubble charts), zooming of the PC Plot Matrix, timestamps/pop-ups/labels in Google Earth plots, mapping of values to strings in PC Plot mouse-overs and Google Earth plots, configurable automatic following of the icon when animating in Google Earth, and much more. You can see screenshots of a bubble plot and a Google Earth plot with timestamps, pop-ups and labels on the features page at http://www.sliversoftware.com/features.htm and details at either http://www.sliversoftware.com/versionchangelog.htm or more easily on page 3 of the updated user's manual.

A new version 1.2.7 of DataTools, a standalone data-munging application that mirrors the functions in the DataTools menu of Sliver, can also be downloaded from http://www.sliversoftware.com/download.htm. This version adds a function to remove commas in double-quoted strings in CSV files, which are treated as delimiters in Sliver. It also adds a function to extract rows that have an entered Boolean combination of values across multiple columns.

Thanks, everyone, for your support. Please let me know if you have any questions or suggestions regarding this new release or Sliver in general.

Ron

3
Announcements / Sliver 1.4 and DataTools 1.2.5 Released
« on: January 17, 2017, 01:24:29 AM »
Hi All,

Sliver v1.4 has just been released and is available at http://www.sliversoftware.com/download.htm. This significant release incorporates a number of new features, most of which were previously leaked at

    http://www.sliversoftware.com/forum/index.php?topic=50.0

Additional features rolled into this release include new Google Earth Connections Plot options to connect pairs of ground coordinates with lines following the surface of the Earth along great circles, or by vertical parabolic arcs above great circles. There is also a brand new Google Earth Pillar Plot feature that draws vertical rods from ground coordinates with optional spheres on top--hard to explain, so please see the examples  :). You can see screenshots of these on the features page at http://www.sliversoftware.com/features.htm and details at either http://www.sliversoftware.com/versionchangelog.htm or more easily on page 3 of the updated user's manual.

A new version 1.2.5 of DataTools, a standalone data-munging application that mirrors the functions in the DataTools menu of Sliver, can also be downloaded from http://www.sliversoftware.com/download.htm. This version works better with data having leading zeros and with file paths containing a dot.

Thanks, everyone, for your support. Please let me know if you have any questions or suggestions regarding this new release or Sliver in general.

Ron

4
Hi All,

The Sliver 1.3 release increased the possible number of colors for range brushing from 8 to 16. The default was still set to 8 because it takes a practiced eye, really, to follow patterns in the non-transparent plots, and even the transparent plots, of more than 8 colors. However, that depends on the individual, and I generally now set the number of range colors to the maximum of 16, which is accomplished through the Options-->Plot Settings menu selection. I'm usually able, particularly with the transparent PC plot and exported PDF plots, to interpret the behavior of the data with this many colors.

But I wanted to point out that PC plots range-brushed with 16 colors look gorgeous, so if you haven't increased the number of colors to 16 you may want to do that to see what you get when you range-brush different axes and different orderings of non-inverted and inverted axes. Kind of cool, and kind of an artistic way to display your data.

Ron

5
Announcements / Preview of Upcoming Features of Sliver 1.4
« on: December 02, 2016, 01:37:10 PM »
Hi All,

I just wanted to give a preview of the main features that will be included in release 14 of Sliver, which introduces significant features. It is in the final stages of testing and performance tweaking and will be released around January 1, but since I've found the new features to be very useful I wanted to let you know to check back for this release!
  • Horizontal compression and expansion of groups of axes to spread out axes of interest while retaining all the data. This has been very helpful when inputting data of many variables.
  • K-means clustering and automatic brushing of the clusters, with a user-selectable number of clusters k and the number of those clusters to rainbow color brush (requires installation of the free R statistical software). Viewing the Transparent PC Plot Window after this function, which is automatic, provides immediate feedback on how well the values for k and the number of brushes worked, providing an iterative process for optimizing the clusters.
  • Export and automatic display of 3D plots in Matlab if installed to take advantage of its excellent interactive 3D plotting capabilities for data color-brushed in Sliver.
  • An option to display histograms and means along the axes, with a user-selectable number of histogram bins. I've found this extremely useful to help interpret overplotted data in concert with range brushing and plotting with transparency.
  • An option to center user-selectable axes on their means or on a selected line to show variations from a reference. This dovetails nicely with a new feature to thicken any selected lines in the PC Plot for easier viewing, where thickened lines when exported to PDF are drawn on top without transparency with a thickness specified in a new option in the PostScript/PDF Export Settings. To highlight specific lines in the PDF file previously required manually editing the intermediate PostScript file.
  • An option to manually enter the range for one or more axes. Having common ranges sometimes helps when comparing variables of the same type (race split times, etc.). This previously required a manual process of adding rows to the data.
  • A Google Earth Path Plot option to not connect a path between points lying farther apart than a user-selected distance. This prevents straight-line paths from being drawn between segments widely separated due to hidden brushes, which really helps when creating multiple KML files representing different layers of data. It is also useful for plotting discrete points with colored supports for data that doesn't represent a path but rather discrete geographic locations.
  • An update of the Count-Based Animation window to make the entries more intuitive. Also, including a Google Earth Path Plot in the animation no longer requires that the plot be created in the current session, and the optional line to a secondary set of coordinates can now be rainbow-colored according to yet another variable. Finally, the DataPlayer controls window is more intuitive, allows user-specified ranges on the row rate, and provides options for looping.
  • An option to select all unbrushed lines, which is helpful when brushing uninteresting lines and then hiding that brush.
  • There are no longer restrictions on certain functions that could not be performed after a Ctrl-Scroll zoom had occurred.
I will announce the release of Sliver 1.4 here soon.

Ron

6
UPDATE: Sliver v1.4 now provides a setting in the Options-->Plot Settings menu for specifying the size of the Transparent PC Plot Window.

The Transparent PC Plot Window is an excellent way to view the relationships in the data, as the alpha transparency provides something of an X-ray view that is crucial when dealing with "overplotting" of most datasets. (As a reminder, press H to view the keystrokes for adjusting the transparency and linewidth in that window). Although exporting to PDF using transparency provides a better result and takes much less time for large datasets, I use the fast and easy transparent window all the time.

The transparent window becomes even more useful in Sliver v1.4 (released soon), which offers a menu option to perform K-means clustering and color brushing of the clusters in the data. This feature provides a way to color brush the data clusters other than color brushing using the Grand Tour, which is limited to 9 variables anyway. The transparent plot can be used to view the resulting brushed clusters and to refine the number of clusters k and the number of those clusters to color brush, which are user input values. This clustering process often requires an iterative process of choosing these values and viewing the results in the transparent window.

Anyway, I just rediscovered something I had forgotten about, and it's not in the User's Manual yet so I thought I'd mention it here. The Transparent PC Plot Window is sized just smaller than the main PC Plot window. So if you want a larger transparent window, just make the PC Plot window larger or full-screen and then create the transparent plot. A larger transparent plot can make a big difference in revealing inner structure.

Ron

7
Announcements / Sliver 1.3 and DataTools 1.2.4 Released
« on: October 29, 2016, 11:34:45 PM »
Hi All,

Sliver v1.3 has just been released and is available at http://www.sliversoftware.com/download.htm. This release incorporates a number of features that I think you will like. These new features are described in detail at http://www.sliversoftware.com/versionchangelog.htm.

A new version 1.2.4 of DataTools, a standalone data-munging application that mirrors the functions in the DataTools menu of Sliver, can also be downloaded from http://www.sliversoftware.com/download.htm. This version adds a "Sort Rows by Column Value" function to sort a data file by values in a selected column. Sorting can be performed in Numeric, ASCII or Dictionary order, either increasing or decreasing. These order types are described in the Sort function window.

Thanks, everyone, for your support. Please let me know if you have any questions or suggestions regarding this new release or Sliver in general.

Ron

8
Announcements / Sliver 1.2.2 and DataTools 1.2.3 Released
« on: July 11, 2016, 12:33:31 AM »
Hi All,

Sliver v1.2.2 has just been released and is available at http://www.sliversoftware.com/download.htm.

The updates include:
  • When selecting variables to load from an input file, users can now save the selections to a file, or load the selections from a previously saved variable selections file through new buttons in the variable selection window. This eliminates the need to manually check off the same set of variables each time a file is loaded. The selections file format is identical to that of the standalone DataTools application, so these variable selection files can be shared.
  • When loading or saving a file, the file browser window now defaults to the directory of the last input or saved file, even across sessions, rather than always starting in the Sliver directory (hooray!).
  • DataTools functions are updated to the latest standalone DataTools v1.2.3, which fixes slow viewing of min/max values, makes sure the functions terminate when returning to the main window, adds new options to some functions, and improves validation of input values.
  • Minor cosmetic and usability updates are incorporated.

For convenience the functions in the DataTools menu of Sliver are also now available in a standalone DataTools application that can be downloaded from the same download page and used for all your data manipulation needs. In addition to the changes listed above, by popular demand the standalone version now allows you to return from a function window to the main window by clicking on the X in the upper corner of the window.

Ron

9
Hi All,

I have noticed that occasionally when the Grand Tour animation is launched, the keyboard commands are not recognized in that window so there is no way to control the parameters of the animation. It seems to occur only intermittently, and on only one of my machines. Exiting the animation and performing a mouse-related operation on the parallel coordinate plot restores the keyboard functionality, after which the Grand Tour can be re-initiated for another attempt. Even then, it should work most of the time. It appears that clicking the mouse on the Grand Tour window prior to using the keyboard may help mitigate this situation. I hope I'm the only one who has experienced this.

Ron

10
Announcements / Sliver v1.2.1 Released
« on: May 18, 2016, 01:17:24 AM »
Hi All,

Sliver v1.2.1 has just been released and is available at http://www.sliversoftware.com/download.htm.

This version upgrades the DataTools menu for manipulating CSV and tab-delimited TXT data files, adding new functions, improving progress indications, and fixing the "Add Column of Calculated Values" that was not populating the values.

For convenience the functions in the DataTools menu of Sliver are also now available in a standalone DataTools application that can be downloaded from the same download page and used for all your data manipulation needs.

Ron

11
Tips and Tutorials / More modifications to an exported plot
« on: May 27, 2015, 12:47:16 AM »
The forum topic titled Accentuating individual lines in an exported plot describes how to directly edit the PostScript file that is created in the process of generating an exported PDF file in order to change the color, opacity and linewidth of individual lines. However, there are other characteristics of the PDF output that you might wish to edit as well. Some of these other characteristics can be changed in Sliver before you export the plot to PDF, but sometimes you don't want to reload a session file just to change one or two attributes of the exported plot.

For example, have a look at the following PDF file (which is rendered better by downloading it and opening it in Acrobat rather than in your browser). It is a PC plot of the split paces (minutes per mile for each 5K split and the finish split) for the top 5000 finishers of the 2015 Boston Marathon.

http://www.sliversoftware.com/Download/Team_Split_Paces_Among_Top_5000_Finishers.pdf

In this PDF I altered some of the characteristics of the original PDF file exported from Sliver. The first three changes below were made to the original exported PostScript file, after which a new PDF file was generated from this edited PostScript file using Adobe Acrobat Distiller. Generally you can just double-click on the PostScript file to launch Distiller as the .ps suffix is associated with that program. The fourth change was made directly to the PDF file.

  • The colors, opacity and widths of polylines for several runners were modified and brought to the front.
  • The axis titles were reduced in length so they would not overlap.
  • The original range labels on the axes were in decimal form ("5.0" and "8.0") because the data was in decimal minutes/mile units. The axes were forced to have these ranges by loading the CSV file, saving the session to a session file, editing the last lines of the session file to have these range values, and then reloading the session file, as described in the forum topic Setting custom ranges on axes. However, the altered PDF now displays these values in minutes and seconds ("5:00" and "8:00") because runners think in minutes and seconds.
  • Labels were added at the ends of the modified polylines to identify the names of the associated runners.

The edits made for each of these are described below. You can view the edited PostScript file by opening the following link in a text editor (not the default Adobe Acrobat Distiller):

http://www.sliversoftware.com/Download/Team_Split_Paces_Among_Top_5000_Finishers.ps


1.  Modified Line Parameters

This follows the steps in the Accentuating individual lines in an exported plot forum post. The lines of interest were uniquely colored in Sliver prior to the export (here they were colored white) and this brush was set as the last to draw in order using the Hide and Show options in the Brushes-->Show/Hide/Recolor Brushes menu option. Then the drawing commands for these lines were located in the PostScript file by searching for that color assignment (here "1.0000 1.0000 0.0000 setrgbcolor" where the numbers represent R, G and B values from 0.0 to 1.0). These line commands were then moved to a later section of the PostScript file after the opacity is set to 100% by the two lines

[ /CA 1.0 /BM /Normal /SetTransparency pdfmark
[ /ca 1.0 /BM /Normal /SetTransparency pdfmark

The two lines above already exist later in the file, so the line drawing commands were just moved after these lines. However, if an opacity other than 1.0 is desired, you can create two new command lines that are the same as those above where the "1.0" are replaced with a different opacity between 0.0 and 1.0. Then you can place the line drawing commands after those new lines.

A new linewidth was set by adding the line "0.055 setlinewidth" before the line commands. Finally, because the polylines overlapped in the plot, different colors were assigned to individual lines by inserting text such as "0.0000 0.0000 1.0000 setrgbcolor" for blue in front of each line drawing command.

The final set of commands for these lines is shown below. As mentioned, the SetTransparency lines already existed in the file.

[ /CA 1.0 /BM /Normal /SetTransparency pdfmark
[ /ca 1.0 /BM /Normal /SetTransparency pdfmark

0.065 setlinewidth
1.0000 0.0000 0.0000 setrgbcolor
1.9477 1.8601 m 4.8708 2.0464 l 7.7940 2.0732 l 10.7171 2.3927 l 13.6403 2.5796 l 16.5634 3.1927 l 19.4866 4.4186 l 22.4097 5.5117 l 25.3329 5.9783 l s
1.0000 0.0000 0.0000 setrgbcolor
1.9477 5.8317 m 4.8708 6.4181 l 7.7940 6.0449 l 10.7171 6.3644 l 13.6403 6.3913 l 16.5634 6.9244 l 19.4866 7.2976 l 22.4097 5.7249 l 25.3329 5.4929 l s
0.0000 0.5000 0.0000 setrgbcolor
1.9477 6.6044 m 4.8708 6.7913 l 7.7940 6.7913 l 10.7171 6.8713 l 13.6403 6.6844 l 16.5634 7.2176 l 19.4866 7.1376 l 22.4097 6.4713 l 25.3329 6.3431 l s
1.0000 1.0000 1.0000 setrgbcolor
1.9477 6.7644 m 4.8708 6.8176 l 7.7940 6.7376 l 10.7171 6.8713 l 13.6403 6.7644 l 16.5634 7.5639 l 19.4866 7.2176 l 22.4097 6.7376 l 25.3329 6.0395 l s
1.0000 1.0000 1.0000 setrgbcolor
1.9477 6.7913 m 4.8708 6.7913 l 7.7940 6.7376 l 10.7171 6.8444 l 13.6403 6.7913 l 16.5634 7.5639 l 19.4866 7.4576 l 22.4097 6.8713 l 25.3329 7.4964 l s
1.0000 0.0000 0.0000 setrgbcolor
1.9477 6.2049 m 4.8708 6.7376 l 7.7940 7.1376 l 10.7171 7.0313 l 13.6403 7.1908 l 16.5634 7.4576 l 19.4866 7.4576 l 22.4097 7.1113 l 25.3329 6.8285 l s
0.0000 0.0000 1.0000 setrgbcolor
1.9477 7.2708 m 4.8708 7.5376 l 7.7940 7.5639 l 10.7171 7.3508 l 13.6403 7.2444 l 16.5634 7.8039 l 19.4866 7.8839 l 22.4097 7.1113 l 25.3329 6.5249 l s
1.0000 1.0000 1.0000 setrgbcolor
1.9477 8.0708 m 4.8708 7.5639 l 7.7940 7.4308 l 10.7171 7.6439 l 13.6403 7.3508 l 16.5634 8.2039 l 19.4866 7.8576 l 22.4097 6.9776 l 25.3329 6.3431 l s
0.0000 0.5000 0.0000 setrgbcolor
1.9477 7.3776 m 4.8708 7.4308 l 7.7940 7.5639 l 10.7171 7.3508 l 13.6403 7.2444 l 16.5634 7.8039 l 19.4866 7.8839 l 22.4097 7.2976 l 25.3329 8.9537 l s
0.0000 0.0000 1.0000 setrgbcolor
1.9477 6.7644 m 4.8708 6.7913 l 7.7940 6.7644 l 10.7171 6.9244 l 13.6403 6.7644 l 16.5634 8.2571 l 19.4866 8.8434 l 22.4097 9.6166 l 25.3329 12.2934 l s


2.  New Axis Titles

This was simple. The title of each axis is given in parentheses in lines near the bottom of the file. New text can be inserted in place of the original axis titles. This text is centered, so the new title will remain centered under the axis. This is an example of one of the lines with the new axis title of "5k Pace":

(5k Pace) dup stringwidth pop 2 div neg 0 rmoveto show

Notice that you can change the font, color and size of this text by editing the command lines right above this section.


3.  New Range Labels

This was also simple. The range labels for each axis are given in parentheses in the command lines just below the title line for each axis. New labels can be entered in place of the original labels inside the parentheses. The labels are always right-justified, so they will not overlap the axes. Here the original command lines with values of 5.0 and 8.0 are now replaced with, for example,

(05:00) -2.2230000000000003 1.8167 showRightX
(08:00) 13.2422 1.8167 showRightX

Again, the font, color and size of the text are defined in the command lines located right above this section.


4.  Adding New Text Labels

The runner name labels at the right ends of the polylines were added directly to the PDF file after it was regenerated from the modified PostScript file. There is an option in Adobe Acrobat to Add or Edit Text Box, and there are options to change the font, the font size, the font color and the background color of a text box. So a text box with a black background was created for each runner and placed at the end of that polyline in the plot, where the text color matches the color of their polyline. You can click on those text boxes in the PDF file to see them.


More Tricks:

There are other edits you can make to the PostScript file to customize it. For example, the background color of the plots are given by command lines near the start of the file that draw a filled rectangular background, such as

0.0000 0.0000 0.0000 setrgbcolor
-0.37 -4.07 m 27.57 -4.07 l 27.57  18.07 l -0.37 18.07 l closepath fill stroke

You can edit the first line to change the RGB color of the background. You can also add an overall plot title either by editing the PostScript file or by adding a text box to the PDF in Adobe Acrobat.

You can modify scatterplots in a PostScript file as well. The color, radius and thickness of any particular hollow point can be modified in the PostScript plot in a similar way as we did above for polylines. You can also change the axes labels, colors and thicknesses, as well as add text labels and a title.

-- Ron

12
When you select the menu option Plots-->Display Values on Mouse-Over, then placing the mouse over any line or scatterplot point highlights it and shows the data values associated with it. This is very useful, for example, to identify the data corresponding to anomalies in the plots. It can also be nice for taking a screen capture for a presentation that shows data of interest along a line or in a scatterplot. And it is convenient for locating lines or points corresponding to particular data so you can select them for color brushing.

For example, I often want to color brush a line in the PC plot that has a particular value for a variable, such as a runner's bib number. So I turn on the menu option above, zoom into the bib number axis, and move the mouse across the lines to display the values at that axis, panning up and down with the scrollbars as needed until I can locate the correct line and swipe to select it for brushing.

However, every time a line or point is highlighted it is brought forward in front of all other lines and points. This tends to scramble the drawing order of the lines, and you may have color brushed the lines in a particular order to overlay them in a certain way. The range brush operation, for example, orders the drawing of the brushes from blue to red. But now some lines and points are drawn out of order.

To restore the brush order, first turn off the display of values on mouse-over by either pressing ESC twice or by selecting the Plots-->Display Values on Mouse-Over menu option again. Then choose the Brushes-->Show/Hide/Recolor Brushes menu option. In the pop-up window set all brushes to be hidden. Then one at a time select each color and press Apply in the order that you want them drawn. When finished, press OK to exit the window, and you have restored your desired brush order.

Ron

13
Tips and Tutorials / Setting custom ranges on axes
« on: May 06, 2015, 12:11:28 AM »
When a data file is read in, the range of each axis is automatically set at the minimum and maximum for that variable. Starting with Sliver version 1.2 it is possible to shift the range of any axis up or down at either the top or bottom. This also has the effect of shifting lines up or down along or even off that axis. You can shift a range by selecting an axis and either using the shifting options under the Axis menu or pressing the arrow keys:

  • Up Arrow: Decrease the top range, shifting the lines up at the top
  • Down Arrow: Increase the top range, shifting the lines down at the top
  • Left Arrow: Increase the bottom range, shifting the lines down at the bottom
  • Right Arrow: Decrease the bottom range, shifting the lines up at the bottom

If pressing the arrow keys shifts through the menus instead, press the ALT key and try again.

These operations change the range at the top or bottom by a 0.9 or 1/0.9 factor. Lines can be shifted right off either end of an axis if desired to zoom into an area of interest along an axis.

However, it may take time to shift lines along multiple axes, and in any event only specific ranges can be set because of the constant factors. However, there is a way to set the axis ranges to your particular values (maybe you want the same range for all of them). First, save the current Sliver session to a CSV file by selecting the File-->Save Session menu option and entering a filename ending in a .csv suffix. Then open that file with any text editor. You will see that the minimum and maximum ranges for each axis, in order, are given in the last lines of the file, separated by commas. Edit those values to the ranges you want, save the file, and select the File-->Restore Session to load it in again. Now the axes will have the ranges you entered.

Note that the format of each line is minimum,maximum regardless of whether the axis has been inverted. The complete format of saved session files is provided in Appendix C of the Sliver User's Manual if you would like to change other attributes of the plot either manually or programmatically.

Ron

14
Hi All,

If you have many datasets to load, particularly when there are repetitive tasks involved in Sliver such as selecting variables, brushing ranges of lines in different colors and perhaps hiding some brushes, and particularly when you want to set specific ranges on the axes, it may be useful to programmatically perform all these functions.

This can be done (and has been done by at least one user) with a script that writes each of your datasets and its Sliver configuration into a session file that can then be "restored" in Sliver. Session files are normally created through the File-->Save Session menu option and then restored through the File-->Restore Session menu option. However, the session file is simply a text file, and you can create your own custom session files for your data. The session file format for Sliver v1.2 is described in Appendix C of the Sliver v1.2 User's Manual. It includes not only the data but also the any selections, brushing or visible/hidden attributes for the data.

Another advantage of the session file is that the last n lines of it provide the minimum and maximum ranges of each axis (assuming there are n axes), so this allows you to customize the ranges as well. In fact, even without scripting it can be handy to save a session file and then edit the last n lines to whatever axis ranges you want before restoring it.

Ron

15
Announcements / Sliver v1.2 Released
« on: April 20, 2015, 07:14:51 PM »
Hi All,

Sliver v1.2 has just been released and is available at http://www.sliversoftware.com/download.htm.

This version has several improvements, including reading time data in hh:mm:ss or mm:ss format, shifting lines off-axis to spread out lines of interest, and other improvements. See the Version Change Log at http://www.sliversoftware.com/versionchangelog.htm or the User's Manual for more information. You can unzip the new version of Sliver into a new folder or overwrite the files in an existing folder. If you use a new folder, you can preserve your previous settings by copying the settings.txt file from the older folder into the new folder while Sliver is not running.

This version also includes fixes for the two bugs I reported earlier on this forum.

Ron

Pages: [1] 2 3