Ask Your Question
1

Does mistral have restrictions on the size of the workbook files it can accept?

asked 2017-01-20 17:01:50 -0500

dale-aavang gravatar image

updated 2017-01-20 17:26:57 -0500

We are using mistral and seem to be running into a limit on how large of a workbook file mistral can successfully load. A file of around 62110 bytes works, but if it grows to 62292 bytes, it fails to load.

Example output:

(mistral) workbook-update my_wb.yaml
ERROR (app) b'A server error occurred.  Please contact the administrator.'
(mistral) quit
[root@host]# ls -l my_wb.yaml
-rw-------. 1 root root 62292 Jan 20 16:50 my_wb.yaml

...yet if the description text in the file is shortened to get the file size down to 62110, it works!

[root@host]# ls -l my_wb.yaml
-rw-------. 1 root root 62110 Jan 20 16:51 my_wb.yaml
[root@host]# mistral workbook-update my_wb.yaml
+------------+---------------------+
| Field      | Value               |
+------------+---------------------+
| Name       | myName              |
| Tags       | <none>              |
| Created at | 2017-01-20 18:10:09 |
| Updated at | 2017-01-20 21:56:07 |
+------------+---------------------+
[root@host]#

We are hoping this is something that can be configured in mistral.conf, but do not know if there is a configuration varialbe available to tune this.

In looking in the /var/log/messages log, I see an error message that points to this probably being a database schema issue.

DBError: (_mysql_exceptions.DataError) (1406, "Data too long for column 'spec' at row 1") [SQL: u'UPDATE workbooks_v2 SET updated_at=%s, definition=%s, spec=%s WHERE workbooks_v2.id = %s']

mysql> desc workbooks_v2;
+------------+-------------+------+-----+---------+-------+
| Field      | Type        | Null | Key | Default | Extra |
+------------+-------------+------+-----+---------+-------+
| created_at | datetime    | YES  |     | NULL    |       |
| updated_at | datetime    | YES  |     | NULL    |       |
| scope      | varchar(80) | YES  | MUL | NULL    |       |
| project_id | varchar(80) | YES  | MUL | NULL    |       |
| id         | varchar(36) | NO   | PRI | NULL    |       |
| name       | varchar(80) | YES  | MUL | NULL    |       |
| definition | text        | YES  |     | NULL    |       |
| spec       | text        | YES  |     | NULL    |       |
| tags       | text        | YES  |     | NULL    |       |
| is_system  | tinyint(1)  | YES  |     | NULL    |       |
+------------+-------------+------+-----+---------+-------+
10 rows in set (0.00 sec)

mysql>

I googled to see what the size limit of "text" was for the "spec" column, and I found the text datatype is limited to 65535 so I'm thinking that is my problem. If it is, are there any plans to increase the size in future releases of mistral?

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted
0

answered 2017-01-23 03:39:08 -0500

d0ugal gravatar image

Which version of Mistral are you using? I think it must be OpenStack Mitaka (Mistral 3.0) or older. The column was changed to mediumtext in the latest stable release (OpenStack Newton / Mistral version 4.0). In MySQL mediumtext should allow you to have 16,777,215 characters - I hope you never go over that in one workbook file :-)

Here is the change if you are interested in haveing a look.

edit flag offensive delete link more

Comments

1

Thank you! We are using mistral version 3.0.0.0b2.dev121. It looks like the change has also been put in version 3.0.2 so we will give that a try.

dale-aavang gravatar imagedale-aavang ( 2017-01-23 12:54:20 -0500 )edit

Great, I forgot it was backported - that should make it an easier upgrade story for you. By the way, it looks like you are using a development release (you can tell by the dev121), this means that it is less likely to be stable, you might want to try and stick to the stable releases.

d0ugal gravatar imaged0ugal ( 2017-01-24 02:44:56 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2017-01-20 17:01:50 -0500

Seen: 61 times

Last updated: Jan 23 '17