Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

THE FOLLOWING INFORMATION IS OUT OF DATE...

Sanity Testing

To improve quality, there will be a greater emphasis on testing.  As a team, we are responsible for the quality of FX and in addition to the usual unit and automated testing, we will be performing weekly sanity tests.

Every Thursday evening / Friday morning for about an hour or two at most, every team members member will sanity test the release. Team members will catch up on all changes from the different components that make up FX and ensure that they can build the product (or test using the latest Hudson build). Friday afternoon morning testing is a time bounded exercise that should not interfere with regular work but will give the team a sense of over all quality in the product.

...

A snapshot of the source code repository will be taken every Friday shortly after 1:00 AM Pacific Time for testing and as a candidate for integration to master for the following week's build. The repo will be locked (frozen) every Friday at 1:00 AM Pacific Time for one hour. No changes are allowed to be pushed to the 9-dev repo until 2:00 AM Pacific Time. Further, developers are strongly encouraged to avoid pushing intrusive changes (e.g., large scale refactoring, WebKit upgrades, etc.) or risky fixes from Thursday 5:00 PM Pacific through Friday 5:00 PM Pacific. Intrusive changes and risky fixes should go in prior to Thursday afternoon (or over the weekend as long as you don't break the build).

Thursday 5:00 PM Pacific -- no more risky or intrusive changes for this week
Friday 1:00 AM Pacific -- repo is locked, testing can begin as soon as a build is available (or you can build it yourself)
Friday 2:00 AM Pacific -- repo is unlocked, safe, non-intrusive changesets can be pushed again, likely for next week's integration
Friday 5:00 PM Pacific -- changesets can be pushed normally again (including intrusive or risky fixes) for next week's integration

...

The following table describes sanity test assignments (* for has machine, ~ for has Vbox):

Committer
Windows
Mac
Linux
Freescale i.MX6 (EGL)
Freescale i.MX6 (sw 32-bit)
Freescale i.MX6 (sw 16-bit)
Raspberry Pi
BeagleBoard
BD-SL-i.MX6
Jonathan*E(O)*E(C)
       

Jim*E(G)*E(G)
  
     Vadim*HS* SB,HS       

Chien**T(C)*T(C)
*    *
Kevin*DF,T(S)*DF,T(S)*DF,T(S)
      
David H
*
~*
E(O)~
T(S)
*  
gtk3*
****
Guru*T(C)
 

*HS
      
Alexander
 

*M*SB
      

Arunprasad

*E(C)
  
      


Murali*SB
       
 


Ankit
  


*E(O),E(C)
Semyon
      Semyon*M
*M
*E(G)
Ajit**HS~
Ambarish*HS
~
Avik
 

*E(
G
O)
 

Manajit
 

*
    
*M
Application

Meaning

E(C)Ensemble8 Controls (Controls, Charts)
E(G)Ensemble8 Graphics (Graphics 2D, Graphics 3D, Scene Graph)
E(O)Ensemble8 Other (Animation, Language, Layout, Media,)
MModena
T(S)Toys - run-subset
.sh; for embedded, use run-core
.sh
T(C)Toys - run-controls.sh
HSHelloSanity

DF

Dev Build Full (use dev-build-full.sh, runs visual tests)
SBSceneBuilder