Casablanca Maintenance Release Stability Testing Status

We will use vFW use case as the baseline to test this:

Pre-requirement: Instantiate a vFW with closed loop running.

VNF Onboarding and Distribution:

Start TimeDurationResultLogsNotes

2019-01-31 22:50:50

09:59

SUCCESS

1


2019-01-31 23:30:00

05:42

SUCCESS

2


2019-02-01 00:30:00

07:49

SUCCESS

3


2019-02-01 01:30:00

05:43

SUCCESS

4


2019-02-01 02:30:00

06:38

SUCCESS

5


2019-02-01 03:30:00

04:01

FAILURE

6

Transient infrastructure issue

2019-02-01 04:30:00

05:53

SUCCESS

7


2019-02-01 05:30:00

06:50

SUCCESS

8


2019-02-01 06:30:00

04:53

SUCCESS

9


2019-02-01 07:30:00

05:45

SUCCESS

10


2019-02-01 08:30:00

05:50

SUCCESS

11


2019-02-01 09:30:00

04:56

SUCCESS

12


2019-02-01 10:30:00

05:39

SUCCESS

13


2019-02-01 11:30:00

05:08

SUCCESS

14


2019-02-01 12:30:00

05:52

SUCCESS

15


2019-02-01 13:30:00

05:51

SUCCESS

16


2019-02-01 14:30:00

06:47

SUCCESS

17


2019-02-01 15:30:00

05:42

SUCCESS

18


2019-02-01 16:30:00

05:05

SUCCESS

19


2019-02-01 17:30:00

04:54

SUCCESS

20


2019-02-01 18:30:00

06:49

SUCCESS

21


2019-02-01 19:30:00

05:41

SUCCESS

22


2019-02-01 20:30:00

05:53

SUCCESS

23


2019-02-01 21:30:00

05:56

SUCCESS

24


2019-02-01 22:30:00

05:40

SUCCESS

25


2019-02-01 23:30:00

06:52

SUCCESS

26


2019-02-02 00:30:00

06:57

SUCCESS

27


2019-02-02 01:30:00

05:44

SUCCESS

28


2019-02-02 02:30:00

05:58

SUCCESS

29


2019-02-02 03:30:00

05:48

SUCCESS

30


2019-02-02 04:30:00

07:40

SUCCESS

31


2019-02-02 05:30:00

04:56

SUCCESS

32


2019-02-02 06:30:00

05:57

SUCCESS

33


2019-02-02 07:30:00

06:36

SUCCESS

34


2019-02-02 08:30:00

06:58

SUCCESS

35


2019-02-02 09:30:00

05:58

SUCCESS

36


2019-02-02 10:30:00

05:41

SUCCESS

37


2019-02-02 11:30:00

06:54

SUCCESS

38


2019-02-02 12:30:00

05:06

SUCCESS

39


2019-02-02 13:30:00

07:49

SUCCESS

40


2019-02-02 14:30:00

05:42

SUCCESS

41


2019-02-02 15:30:00

05:46

SUCCESS

42


2019-02-02 16:30:00

05:47

SUCCESS

43


2019-02-02 17:30:00

06:49

SUCCESS

44


2019-02-02 18:30:00

06:53

SUCCESS

45


2019-02-02 19:30:00

05:36

SUCCESS

46


2019-02-02 20:30:00

04:57

SUCCESS

47


2019-02-02 21:30:00

07:01

SUCCESS

48


2019-02-02 22:30:00

05:47

SUCCESS

49


2019-02-02 23:30:00

06:44

SUCCESS

50


2019-02-03 00:30:00

05:56

SUCCESS

51


2019-02-03 01:30:00

07:57

SUCCESS

52


2019-02-03 02:30:00

05:54

SUCCESS

53


2019-02-03 03:30:00

06:43

SUCCESS

54


2019-02-03 04:30:00

06:43

SUCCESS

55


2019-02-03 05:30:00

05:40

SUCCESS

56


2019-02-03 06:30:00

05:45

SUCCESS

57


2019-02-03 07:30:00

06:38

SUCCESS

58


2019-02-03 08:30:00

07:00

SUCCESS

59


2019-02-03 09:30:00

06:53

SUCCESS

60


2019-02-03 10:30:00

04:52

SUCCESS

61


2019-02-03 11:30:00

05:54

SUCCESS

62


2019-02-03 12:30:00

05:46

SUCCESS

63


2019-02-03 13:30:00

06:55

SUCCESS

64


2019-02-03 14:30:00

06:59

SUCCESS

65


2019-02-03 15:30:00

06:56

SUCCESS

66


2019-02-03 16:30:00

05:51

SUCCESS

67


2019-02-03 17:30:00

05:47

SUCCESS

68


2019-02-03 18:30:00

05:54

SUCCESS

69


2019-02-03 19:30:00

06:42

SUCCESS

70


2019-02-03 20:30:00

05:46

SUCCESS

71


2019-02-03 21:30:00

06:40

SUCCESS

72


2019-02-03 22:30:00

06:55

SUCCESS

73


2019-02-03 23:30:00

04:52

SUCCESS

74


2019-02-04 00:30:00

05:40

SUCCESS

75


2019-02-04 01:30:00

05:50

SUCCESS

76


2019-02-04 02:30:00

05:49

SUCCESS

77


2019-02-04 03:30:00

05:54

SUCCESS

78


2019-02-04 04:30:00

02:45

FAILURE

79

Transient infrastructure issue

2019-02-04 05:30:00

04:48

SUCCESS

80


2019-02-04 06:30:00

05:47

SUCCESS

81


2019-02-04 07:30:00

05:52

SUCCESS

82


2019-02-04 08:30:00

05:48

SUCCESS

83


2019-02-04 09:30:00

09:34

FAILURE

84

Transient infrastructure issue

2019-02-04 10:30:00

06:00

SUCCESS

85


VNF Instantiation: 

Start TimeDurationResultLogsNotes

2019-01-31 22:51:14

12:19

SUCCESS

1


2019-01-31 23:38:00

09:49

SUCCESS

2


2019-02-01 00:38:00

09:50

SUCCESS

3


2019-02-01 01:38:00

03:19

FAILURE

4

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-01 02:38:00

10:51

SUCCESS

5


2019-02-01 03:38:00

04:20

FAILURE

6

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-01 04:38:00

11:08

SUCCESS

7


2019-02-01 05:38:00

04:26

FAILURE

8

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-01 06:38:00

10:28

SUCCESS

9


2019-02-01 07:38:00

10:41

SUCCESS

10


2019-02-01 08:38:00

10:26

SUCCESS

11


2019-02-01 09:38:00

11:06

SUCCESS

12


2019-02-01 10:38:00

04:18

FAILURE

13

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-01 11:38:00

10:16

SUCCESS

14


2019-02-01 12:38:00

10:47

SUCCESS

15


2019-02-01 13:38:00

03:51

FAILURE

16

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-01 14:38:00

10:22

SUCCESS

17


2019-02-01 15:38:00

10:19

SUCCESS

18


2019-02-01 16:38:00

10:57

SUCCESS

19


2019-02-01 17:38:00

04:15

FAILURE

20

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-01 18:38:00

10:18

SUCCESS

21


2019-02-01 19:38:00

10:29

SUCCESS

22


2019-02-01 20:38:00

03:48

FAILURE

23

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-01 21:38:00

10:21

SUCCESS

24


2019-02-01 22:38:00

10:30

SUCCESS

25


2019-02-01 23:38:00

10:42

SUCCESS

26


2019-02-02 00:38:00

12:15

SUCCESS

27


2019-02-02 01:38:00

10:03

SUCCESS

28


2019-02-02 02:38:00

09:11

FAILURE

29

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-02 03:38:00

10:42

SUCCESS

30


2019-02-02 04:38:00

10:11

SUCCESS

31


2019-02-02 05:38:00

10:08

SUCCESS

32


2019-02-02 06:38:00

10:40

SUCCESS

33


2019-02-02 07:38:00

04:11

FAILURE

34

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-02 08:38:00

10:26

SUCCESS

35


2019-02-02 09:38:00

03:49

FAILURE

36

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-02 10:38:00

10:02

SUCCESS

37


2019-02-02 11:38:00

10:12

SUCCESS

38


2019-02-02 12:38:00

03:34

FAILURE

39

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-02 13:38:00

11:01

SUCCESS

40


2019-02-02 14:38:00

04:04

FAILURE

41

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-02 15:38:00

10:17

SUCCESS

42


2019-02-02 16:38:00

10:23

SUCCESS

43


2019-02-02 17:38:00

03:49

FAILURE

44

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-02 18:38:00

10:19

SUCCESS

45


2019-02-02 19:38:00

03:48

FAILURE

46

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-02 20:38:00

10:37

SUCCESS

47


2019-02-02 21:38:00

04:11

FAILURE

48

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-02 22:38:00

10:29

SUCCESS

49


2019-02-02 23:38:00

03:35

FAILURE

50

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-03 00:38:00

09:55

SUCCESS

51


2019-02-03 01:38:00

10:36

SUCCESS

52


2019-02-03 02:38:00

03:44

FAILURE

53

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-03 03:38:00

10:08

SUCCESS

54


2019-02-03 04:38:00

10:48

SUCCESS

55


2019-02-03 05:38:00

10:01

SUCCESS

56


2019-02-03 06:38:00

10:19

SUCCESS

57


2019-02-03 07:38:00

10:20

SUCCESS

58


2019-02-03 08:38:00

06:44

FAILURE

59

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-03 09:38:00

09:52

SUCCESS

60


2019-02-03 10:38:00

10:34

SUCCESS

61


2019-02-03 11:38:00

11:10

SUCCESS

62


2019-02-03 12:38:00

09:56

SUCCESS

63


2019-02-03 13:38:00

10:00

SUCCESS

64


2019-02-03 14:38:00

06:30

FAILURE

65

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-03 15:38:00

10:12

SUCCESS

66


2019-02-03 16:38:00

10:14

SUCCESS

67


2019-02-03 17:38:00

10:59

SUCCESS

68


2019-02-03 18:38:00

11:17

SUCCESS

69


2019-02-03 19:38:00

09:58

SUCCESS

70


2019-02-03 20:38:00

09:59

SUCCESS

71


2019-02-03 21:38:00

06:33

FAILURE

72

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-03 22:38:00

10:04

SUCCESS

73


2019-02-03 23:38:00

03:54

FAILURE

74

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-04 00:38:00

10:57

SUCCESS

75


2019-02-04 01:38:00

11:36

SUCCESS

76


2019-02-04 02:38:00

10:19

SUCCESS

77


2019-02-04 03:38:00

10:49

SUCCESS

78


2019-02-04 04:38:00

07:03

FAILURE

79

Known OpenStack infra issue:
The request you have made requires authentication.

2019-02-04 05:38:00

10:12

SUCCESS

80


2019-02-04 06:38:00

10:29

SUCCESS

81


2019-02-04 07:38:00

11:02

SUCCESS

82


Closed Loop: 

Start TimeDurationResultLogsNotes

2019-02-01T14:24:00

02:24

SUCCESS

143


2019-02-01T15:24:00

04:03

SUCCESS

144


2019-02-01T16:24:00

02:22

SUCCESS

145


2019-02-01T17:24:00

03:21

SUCCESS

146


2019-02-01T18:24:00

03:18

SUCCESS

147


2019-02-01T19:24:00

03:06

SUCCESS

148


2019-02-01T20:24:00

02:20

SUCCESS

149


2019-02-01T21:24:00

02:20

SUCCESS

150


2019-02-01T22:24:00

02:22

SUCCESS

151


2019-02-01T23:24:00

02:53

SUCCESS

152


2019-02-02T00:24:00

03:08

SUCCESS

153


2019-02-02T01:24:00

03:09

SUCCESS

154


2019-02-02T02:24:00

02:18

SUCCESS

155


2019-02-02T03:24:00

02:18

SUCCESS

156


2019-02-02T04:24:00

02:22

SUCCESS

157


2019-02-02T05:24:00

03:24

SUCCESS

158


2019-02-02T06:24:00

03:07

SUCCESS

159


2019-02-02T07:24:00

02:16

SUCCESS

160


2019-02-02T08:24:00

02:16

SUCCESS

161


2019-02-02T09:24:00

02:17

SUCCESS

162


2019-02-02T10:24:00

02:22

SUCCESS

163


2019-02-02T11:24:00

02:19

SUCCESS

164


2019-02-02T12:24:00

04:00

SUCCESS

165


2019-02-02T13:24:00

02:21

SUCCESS

166


2019-02-02T14:24:00

02:19

SUCCESS

167


2019-02-02T15:24:00

02:04

SUCCESS

168


2019-02-02T16:24:00

03:04

SUCCESS

169


2019-02-02T17:24:00

02:06

SUCCESS

170


2019-02-02T18:24:00

02:04

SUCCESS

171


2019-02-02T19:24:00

02:23

SUCCESS

172


2019-02-02T20:24:00

02:01

SUCCESS

173


2019-02-02T21:24:00

02:01

SUCCESS

174


2019-02-02T22:24:00

02:20

SUCCESS

175


2019-02-02T23:24:00

02:04

SUCCESS

176


2019-02-03T00:24:00

02:04

SUCCESS

177


2019-02-03T01:24:00

02:05

SUCCESS

178


2019-02-03T02:24:00

03:05

SUCCESS

179


2019-02-03T03:24:00

02:15

SUCCESS

180


2019-02-03T04:24:00

02:00

SUCCESS

181


2019-02-03T05:24:00

02:01

SUCCESS

182


2019-02-03T06:24:00

02:16

SUCCESS

183


2019-02-03T07:24:00

02:14

SUCCESS

184


2019-02-03T08:24:00

02:16

SUCCESS

185


2019-02-03T09:24:00

02:16

SUCCESS

186


2019-02-03T10:24:00

03:00

SUCCESS

187


2019-02-03T11:24:00

03:00

SUCCESS

188


2019-02-03T12:24:00

02:01

SUCCESS

189


2019-02-03T13:24:00

03:02

SUCCESS

190


2019-02-03T14:24:00

02:14

SUCCESS

191


2019-02-03T15:24:00

02:59

SUCCESS

192


2019-02-03T16:24:00

02:14

SUCCESS

193


2019-02-03T17:24:00

03:15

SUCCESS

194


2019-02-03T18:24:00

03:02

SUCCESS

195


2019-02-03T19:24:00

03:01

SUCCESS

196


2019-02-03T20:24:00

02:15

SUCCESS

197


2019-02-03T21:24:00

03:15

SUCCESS

198


2019-02-03T22:24:00

02:16

SUCCESS

199


2019-02-03T23:24:00

03:00

SUCCESS

200


2019-02-04T00:24:00

03:16

SUCCESS

201


2019-02-04T01:24:00

03:04

SUCCESS

202


2019-02-04T02:24:00

03:05

SUCCESS

203


2019-02-04T03:24:00

03:04

SUCCESS

204


2019-02-04T04:24:00

03:05

SUCCESS

205


2019-02-04T05:24:00

03:05

SUCCESS

206


2019-02-04T06:24:00

02:22

SUCCESS

207


2019-02-04T07:24:00

03:06

SUCCESS

208


2019-02-04T08:24:00

03:20

SUCCESS

209


2019-02-04T09:24:00

02:22

SUCCESS

210


2019-02-04T10:24:00

03:08

SUCCESS

211


2019-02-04T11:24:00

02:24

SUCCESS

212


2019-02-04T12:24:00

02:07

SUCCESS

213


2019-02-04T13:24:00

02:06

SUCCESS

214




Requirement

Area

Priority

Min. Level

Stretch Goal

Level Descriptions (Abbreviated)

Resiliency

High

Level 2 – run-time projects
Level 1 – remaining projects

Level 3 – run-time projects
Level 2 – remaining projects

•1 – manual failure and recovery (< 30 minutes)
•2 – automated detection and recovery (single site) (<30 minutes)
•3 – automated detection and recovery (geo redundancy)